2023-07-29T16:25:42.178 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T16:25:42.179 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} --archive /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886 --verbose --name yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/orig.config.yaml 2023-07-29T16:25:42.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:25:42.305 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886 branch: reef-release description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} email: null first_in_suite: false job_id: '7356886' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef-release ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 3661 sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 targets: smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi151.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 61140164d2579c30ffff3970615e0f82e40c6470 timestamp: 2023-07-29_14:04:17 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-29T16:25:42.305 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa; will attempt to use it 2023-07-29T16:25:42.306 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks 2023-07-29T16:25:42.306 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-29T16:25:42.308 INFO:teuthology.task.internal:Checking packages... 2023-07-29T16:25:42.337 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '0484097b0572e96f42cf6402cbe0ac8dcb046577' 2023-07-29T16:25:42.337 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-29T16:25:42.338 INFO:teuthology.packaging:ref: None 2023-07-29T16:25:42.338 INFO:teuthology.packaging:tag: None 2023-07-29T16:25:42.338 INFO:teuthology.packaging:branch: reef-release 2023-07-29T16:25:42.338 INFO:teuthology.packaging:sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:25:42.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef-release 2023-07-29T16:25:42.648 INFO:teuthology.task.internal:Found packages for ceph version 18.1.3-11.g0484097b 2023-07-29T16:25:42.649 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-29T16:25:42.665 INFO:teuthology.task.internal:no buildpackages task found 2023-07-29T16:25:42.666 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-29T16:25:42.672 INFO:teuthology.task.internal:Saving configuration 2023-07-29T16:25:42.685 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-29T16:25:42.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:25:42.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.863685', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T16:25:42.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.862188', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T16:25:42.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.866376', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T16:25:42.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.865045', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T16:25:42.795 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-29T16:25:42.801 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-07-29T16:25:42.801 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['osd.0'] 2023-07-29T16:25:42.801 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['osd.1'] 2023-07-29T16:25:42.801 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['osd.2'] 2023-07-29T16:25:42.801 INFO:teuthology.run_tasks:Running task console_log... 2023-07-29T16:25:42.951 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdff5182ee0>, signals=[15]) 2023-07-29T16:25:42.953 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-29T16:25:42.964 INFO:teuthology.task.internal:Opening connections... 2023-07-29T16:25:42.965 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2023-07-29T16:25:42.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:25:43.087 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2023-07-29T16:25:43.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:25:43.158 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2023-07-29T16:25:43.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:25:43.225 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:25:43.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:25:43.294 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-29T16:25:43.304 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-07-29T16:25:43.325 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-07-29T16:25:43.326 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-07-29T16:25:43.388 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T16:25:43.388 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-07-29T16:25:43.389 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T16:25:43.390 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T16:25:43.391 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T16:25:43.391 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-07-29T16:25:43.415 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-07-29T16:25:43.436 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-07-29T16:25:43.436 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-29T16:25:43.496 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T16:25:43.496 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T16:25:43.496 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-07-29T16:25:43.496 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-07-29T16:25:43.496 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T16:25:43.497 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:25:43.498 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:25:43.498 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:25:43.498 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T16:25:43.498 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T16:25:43.498 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T16:25:43.499 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-29T16:25:43.523 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-07-29T16:25:43.544 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-07-29T16:25:43.544 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-29T16:25:43.604 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T16:25:43.605 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:25:43.606 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T16:25:43.607 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T16:25:43.607 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T16:25:43.607 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-29T16:25:43.632 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-07-29T16:25:43.652 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-07-29T16:25:43.652 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-29T16:25:43.711 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T16:25:43.711 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T16:25:43.711 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-07-29T16:25:43.711 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T16:25:43.712 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T16:25:43.713 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:25:43.713 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T16:25:43.713 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T16:25:43.713 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T16:25:43.713 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T16:25:43.713 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-29T16:25:43.748 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-29T16:25:43.757 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-29T16:25:43.789 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-29T16:25:43.789 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:25:43.792 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:25:43.794 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:25:43.796 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-07-29T16:25:43.813 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-29T16:25:43.820 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-29T16:25:43.820 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:25:43.853 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:25:43.855 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:25:43.857 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-07-29T16:25:43.889 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-29T16:25:44.003 INFO:teuthology.run_tasks:Running task kernel... 2023-07-29T16:25:44.020 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-29T16:25:44.020 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-29T16:25:44.021 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:25:44.022 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:25:44.022 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:25:44.023 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T16:25:44.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:25:44.041 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-07-29T16:25:44.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:25:44.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:25:44.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:25:44.044 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-07-29T16:25:44.045 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2023-07-29T16:25:44.045 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-07-29T16:25:44.099 INFO:teuthology.orchestra.run.smithi102.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.099 INFO:teuthology.task.kernel:Running kernel on smithi102: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.100 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2023-07-29T16:25:44.102 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.102 INFO:teuthology.task.kernel:Running kernel on smithi098: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2023-07-29T16:25:44.103 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.103 INFO:teuthology.task.kernel:Running kernel on smithi151: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2023-07-29T16:25:44.105 INFO:teuthology.orchestra.run.smithi070.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.105 INFO:teuthology.task.kernel:Running kernel on smithi070: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:44.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2023-07-29T16:25:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:45.317 INFO:teuthology.orchestra.run.smithi102.stdout:Unable to read consumer identity 2023-07-29T16:25:45.328 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:45.328 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2023-07-29T16:25:45.339 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:45.339 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-07-29T16:25:45.391 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:45.391 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-07-29T16:25:46.854 INFO:teuthology.orchestra.run.smithi102.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-07-29T16:25:46.863 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-07-29T16:25:47.008 INFO:teuthology.orchestra.run.smithi070.stdout:Copr repo for python3-asyncssh owned by ceph 9.4 kB/s | 3.5 kB 00:00 2023-07-29T16:25:47.035 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 9.0 kB/s | 3.5 kB 00:00 2023-07-29T16:25:48.496 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 16 MB 00:01 2023-07-29T16:25:48.512 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2023-07-29T16:25:49.210 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 16 MB 00:02 2023-07-29T16:25:51.922 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 397 kB/s | 24 kB 00:00 2023-07-29T16:25:51.979 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 334 kB/s | 24 kB 00:00 2023-07-29T16:25:52.249 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 16 MB 00:05 2023-07-29T16:25:52.624 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-29T16:25:52.660 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-07-29T16:25:52.674 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-29T16:25:52.675 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-07-29T16:25:52.675 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-29T16:25:52.682 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-29T16:25:52.736 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-07-29T16:25:52.737 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2023-07-29T16:25:52.737 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-07-29T16:25:52.804 DEBUG:teuthology.orchestra.run.smithi151:> echo no | sudo yum reinstall kernel || true 2023-07-29T16:25:52.862 DEBUG:teuthology.orchestra.run.smithi102:> echo no | sudo yum reinstall kernel || true 2023-07-29T16:25:53.141 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:53.142 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-07-29T16:25:53.193 INFO:teuthology.orchestra.run.smithi102.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:53.194 INFO:teuthology.orchestra.run.smithi102.stdout:Unable to read consumer identity 2023-07-29T16:25:53.371 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-29T16:25:53.407 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:51 PM UTC. 2023-07-29T16:25:53.428 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-07-29T16:25:53.429 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-07-29T16:25:53.429 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-07-29T16:25:53.451 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:53.456 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:51 PM UTC. 2023-07-29T16:25:53.492 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:53.498 INFO:teuthology.orchestra.run.smithi102.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:53.534 INFO:teuthology.orchestra.run.smithi102.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:53.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum reinstall -y kernel || true 2023-07-29T16:25:53.553 DEBUG:teuthology.orchestra.run.smithi098:> echo no | sudo yum reinstall kernel || true 2023-07-29T16:25:53.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum reinstall -y kernel || true 2023-07-29T16:25:53.872 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:53.873 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-07-29T16:25:53.909 INFO:teuthology.orchestra.run.smithi102.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:53.909 INFO:teuthology.orchestra.run.smithi102.stdout:Unable to read consumer identity 2023-07-29T16:25:53.923 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:53.923 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2023-07-29T16:25:54.126 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:51 PM UTC. 2023-07-29T16:25:54.161 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:03 ago on Sat 29 Jul 2023 04:25:51 PM UTC. 2023-07-29T16:25:54.165 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:54.181 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:52 PM UTC. 2023-07-29T16:25:54.190 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:54.200 INFO:teuthology.orchestra.run.smithi102.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:54.222 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:54.242 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:25:54.265 INFO:teuthology.orchestra.run.smithi098.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:54.271 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:25:54.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum reinstall -y kernel || true 2023-07-29T16:25:54.321 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:54.322 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:54.322 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-29T16:25:54.322 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-07-29T16:25:54.322 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:25:54.352 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:54.352 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:54.352 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-29T16:25:54.353 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-07-29T16:25:54.353 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:25:54.356 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-07-29T16:25:54.369 DEBUG:teuthology.parallel:result is None 2023-07-29T16:25:54.380 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2023-07-29T16:25:54.393 DEBUG:teuthology.parallel:result is None 2023-07-29T16:25:54.640 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:54.640 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2023-07-29T16:25:54.896 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:52 PM UTC. 2023-07-29T16:25:54.938 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:54.970 INFO:teuthology.orchestra.run.smithi098.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:55.016 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:25:55.096 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:55.097 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:55.097 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-29T16:25:55.097 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-07-29T16:25:55.098 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:25:55.124 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2023-07-29T16:25:55.137 DEBUG:teuthology.parallel:result is None 2023-07-29T16:25:55.649 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 498 kB/s | 24 kB 00:00 2023-07-29T16:25:56.318 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-29T16:25:56.366 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-07-29T16:25:56.367 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2023-07-29T16:25:56.367 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-07-29T16:25:56.518 DEBUG:teuthology.orchestra.run.smithi070:> echo no | sudo yum reinstall kernel || true 2023-07-29T16:25:56.851 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:56.851 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-07-29T16:25:57.109 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:55 PM UTC. 2023-07-29T16:25:57.152 INFO:teuthology.orchestra.run.smithi070.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:57.191 INFO:teuthology.orchestra.run.smithi070.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:57.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum reinstall -y kernel || true 2023-07-29T16:25:57.564 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-07-29T16:25:57.565 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-07-29T16:25:57.816 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 04:25:55 PM UTC. 2023-07-29T16:25:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T16:25:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:Error: No packages marked for reinstall. 2023-07-29T16:25:57.941 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T16:25:58.021 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:58.022 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-29T16:25:58.023 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-29T16:25:58.023 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-29T16:25:58.023 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-29T16:25:58.056 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2023-07-29T16:25:58.072 DEBUG:teuthology.parallel:result is None 2023-07-29T16:25:58.073 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-29T16:25:58.080 INFO:teuthology.task.internal:Creating test directory... 2023-07-29T16:25:58.081 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:25:58.113 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:25:58.116 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:25:58.118 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T16:25:58.138 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-29T16:25:58.144 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-29T16:25:58.150 INFO:teuthology.task.internal:Creating archive directory... 2023-07-29T16:25:58.150 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:25:58.169 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:25:58.175 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:25:58.178 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T16:25:58.202 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-29T16:25:58.209 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-29T16:25:58.209 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:25:58.226 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:25:58.236 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:25:58.237 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T16:25:58.267 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.273 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.274 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.278 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.282 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.283 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.287 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.293 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T16:25:58.295 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-29T16:25:58.302 INFO:teuthology.task.internal:Configuring sudo... 2023-07-29T16:25:58.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:25:58.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:25:58.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:25:58.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T16:25:58.361 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-29T16:25:58.370 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-29T16:25:58.370 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:25:58.372 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:25:58.401 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:25:58.404 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:25:58.422 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:58.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:58.516 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:58.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:58.642 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:25:58.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:25:58.709 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:58.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:58.806 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:58.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:58.935 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:25:58.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:25:59.005 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:59.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:59.106 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:59.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:59.238 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:25:59.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:25:59.310 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:59.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:25:59.425 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:59.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:25:59.514 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:25:59.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T16:25:59.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2023-07-29T16:25:59.585 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2023-07-29T16:25:59.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2023-07-29T16:25:59.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-07-29T16:25:59.649 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:25:59.653 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:25:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:25:59.680 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:26:00.175 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-29T16:26:00.184 INFO:teuthology.task.internal:Starting timer... 2023-07-29T16:26:00.184 INFO:teuthology.run_tasks:Running task pcp... 2023-07-29T16:26:00.194 INFO:teuthology.run_tasks:Running task selinux... 2023-07-29T16:26:00.203 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-29T16:26:00.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2023-07-29T16:26:00.270 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2023-07-29T16:26:00.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2023-07-29T16:26:00.338 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2023-07-29T16:26:00.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2023-07-29T16:26:00.419 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2023-07-29T16:26:00.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-07-29T16:26:00.476 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-07-29T16:26:00.479 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-29T16:26:00.480 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2023-07-29T16:26:00.505 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2023-07-29T16:26:00.505 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2023-07-29T16:26:00.528 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2023-07-29T16:26:00.529 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2023-07-29T16:26:00.555 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2023-07-29T16:26:00.555 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-07-29T16:26:00.576 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-07-29T16:26:00.577 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-07-29T16:26:00.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:26:00.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:26:00.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:26:00.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:26:00.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:26:00.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:26:00.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:26:00.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:26:00.689 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-29T16:26:00.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:26:00.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:26:00.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:26:00.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-07-29T16:26:00.800 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-29T16:26:00.810 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-29T16:26:00.815 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-29T16:26:00.942 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-29T16:26:00.964 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-29T16:26:00.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi102.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-29T16:34:38.114 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-07-29T16:34:38.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-07-29T16:34:38.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:34:38.185 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-07-29T16:34:38.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-07-29T16:34:38.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-29T16:34:38.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:34:38.277 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-07-29T16:34:38.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-29T16:34:38.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-29T16:34:38.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:34:38.419 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-07-29T16:34:38.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-29T16:34:38.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-29T16:34:38.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:34:38.559 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-29T16:34:38.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-29T16:34:38.627 INFO:teuthology.run_tasks:Running task clock... 2023-07-29T16:34:38.637 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-29T16:34:38.637 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T16:34:38.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:34:38.640 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T16:34:38.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:34:38.643 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T16:34:38.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:34:38.645 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T16:34:38.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:34:38.671 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T16:34:38.674 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T16:34:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T16:34:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T16:34:38.689 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T16:34:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T16:34:38.697 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T16:34:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T16:34:38.756 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2023-07-29T16:34:38.768 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2023-07-29T16:34:38.772 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2023-07-29T16:34:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2023-07-29T16:34:38.779 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-07-29T16:34:38.782 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T16:34:38.784 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2023-07-29T16:34:38.786 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2023-07-29T16:34:38.791 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-07-29T16:34:38.795 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T16:34:38.799 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T16:34:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T16:34:38.806 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T16:34:38.813 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T16:34:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T16:34:38.820 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T16:34:38.866 INFO:teuthology.orchestra.run.smithi070.stderr:bash: ntpq: command not found 2023-07-29T16:34:38.869 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:34:38.869 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2023-07-29T16:34:38.870 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.870 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.870 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.870 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.889 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-07-29T16:34:38.892 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:34:38.893 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-07-29T16:34:38.893 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.893 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.893 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.893 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-07-29T16:34:38.903 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:34:38.903 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-07-29T16:34:38.903 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.903 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.904 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.904 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.908 INFO:teuthology.orchestra.run.smithi102.stderr:bash: ntpq: command not found 2023-07-29T16:34:38.912 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:34:38.912 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-07-29T16:34:38.912 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.912 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.912 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.913 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:34:38.913 INFO:teuthology.run_tasks:Running task install... 2023-07-29T16:34:38.921 DEBUG:teuthology.task.install:project ceph 2023-07-29T16:34:38.922 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}} 2023-07-29T16:34:38.922 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'} 2023-07-29T16:34:38.922 INFO:teuthology.task.install:Using flavor: default 2023-07-29T16:34:38.928 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-29T16:34:38.929 INFO:teuthology.task.install:extra packages: [] 2023-07-29T16:34:38.929 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T16:34:38.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:34:38.932 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T16:34:38.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:34:38.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T16:34:38.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:34:38.935 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T16:34:38.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:34:39.205 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T16:34:39.205 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T16:34:39.209 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T16:34:39.210 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T16:34:39.218 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T16:34:39.218 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T16:34:39.220 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T16:34:39.220 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T16:34:39.400 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T16:34:39.400 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:34:39.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T16:34:39.426 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T16:34:39.426 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:34:39.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T16:34:39.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T16:34:39.430 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T16:34:39.431 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T16:34:39.431 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:34:39.431 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T16:34:39.435 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T16:34:39.435 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:34:39.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T16:34:39.456 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T16:34:39.457 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T16:34:39.462 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T16:34:39.463 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T16:34:39.465 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-07-29T16:34:39.466 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T16:34:39.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T16:34:39.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T16:34:39.530 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T16:34:39.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T16:34:39.574 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T16:34:39.604 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T16:34:39.605 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T16:34:39.613 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T16:34:39.640 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2023-07-29T16:34:39.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2023-07-29T16:34:39.669 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-07-29T16:34:39.670 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2023-07-29T16:34:39.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-07-29T16:34:39.672 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2023-07-29T16:34:39.679 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2023-07-29T16:34:39.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2023-07-29T16:34:40.012 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.041 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.043 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.050 INFO:teuthology.orchestra.run.smithi102.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.293 INFO:teuthology.orchestra.run.smithi070.stdout:44 files removed 2023-07-29T16:34:40.325 INFO:teuthology.orchestra.run.smithi098.stdout:44 files removed 2023-07-29T16:34:40.334 INFO:teuthology.orchestra.run.smithi151.stdout:44 files removed 2023-07-29T16:34:40.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T16:34:40.341 INFO:teuthology.orchestra.run.smithi102.stdout:44 files removed 2023-07-29T16:34:40.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T16:34:40.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T16:34:40.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-07-29T16:34:40.669 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.702 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.717 INFO:teuthology.orchestra.run.smithi102.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:40.718 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-29T16:34:41.667 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 130 kB/s | 80 kB 00:00 2023-07-29T16:34:41.669 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 131 kB/s | 80 kB 00:00 2023-07-29T16:34:41.712 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 129 kB/s | 80 kB 00:00 2023-07-29T16:34:41.716 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 131 kB/s | 80 kB 00:00 2023-07-29T16:34:42.213 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2023-07-29T16:34:42.213 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-07-29T16:34:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-07-29T16:34:42.243 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-29T16:34:42.701 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-07-29T16:34:42.713 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 3.1 kB/s | 1.5 kB 00:00 2023-07-29T16:34:42.714 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 3.1 kB/s | 1.5 kB 00:00 2023-07-29T16:34:42.727 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-07-29T16:34:42.951 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-07-29T16:34:42.972 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-07-29T16:34:42.978 INFO:teuthology.orchestra.run.smithi070.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-07-29T16:34:42.981 INFO:teuthology.orchestra.run.smithi102.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-29T16:34:47.002 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 16 MB 00:04 2023-07-29T16:34:47.789 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 16 MB 00:04 2023-07-29T16:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 16 MB 00:05 2023-07-29T16:34:50.552 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 314 kB/s | 24 kB 00:00 2023-07-29T16:34:51.190 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 398 kB/s | 24 kB 00:00 2023-07-29T16:34:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-07-29T16:34:51.861 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 381 kB/s | 24 kB 00:00 2023-07-29T16:34:52.192 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 MB/s | 53 MB 00:00 2023-07-29T16:34:52.542 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 16 MB 00:09 2023-07-29T16:34:52.804 INFO:teuthology.orchestra.run.smithi070.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-07-29T16:34:55.964 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-07-29T16:34:56.860 INFO:teuthology.orchestra.run.smithi102.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-07-29T16:34:59.571 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-07-29T16:35:00.368 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-07-29T16:35:00.854 INFO:teuthology.orchestra.run.smithi070.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-07-29T16:35:04.728 INFO:teuthology.orchestra.run.smithi102.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-07-29T16:35:10.885 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:10.886 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:11.033 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-29T16:35:11.044 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================================================= 2023-07-29T16:35:11.044 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================================================= 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T16:35:11.045 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T16:35:11.046 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T16:35:11.047 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T16:35:11.048 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T16:35:11.049 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T16:35:11.050 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T16:35:11.051 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T16:35:11.052 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T16:35:11.053 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T16:35:11.054 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T16:35:11.055 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T16:35:11.056 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T16:35:11.057 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T16:35:11.058 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:11.059 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T16:35:11.060 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T16:35:11.061 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================================================= 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout:Install 120 Packages 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 2 Packages 2023-07-29T16:35:11.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:35:11.063 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 194 M 2023-07-29T16:35:11.063 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-07-29T16:35:11.287 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:11.288 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:11.434 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-07-29T16:35:11.445 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================================= 2023-07-29T16:35:11.446 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-07-29T16:35:11.446 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================================= 2023-07-29T16:35:11.446 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-07-29T16:35:11.446 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T16:35:11.446 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T16:35:11.447 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T16:35:11.448 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T16:35:11.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T16:35:11.450 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T16:35:11.451 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T16:35:11.452 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T16:35:11.452 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T16:35:11.452 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T16:35:11.452 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T16:35:11.452 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T16:35:11.453 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T16:35:11.453 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T16:35:11.453 INFO:teuthology.orchestra.run.smithi098.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T16:35:11.453 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T16:35:11.453 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T16:35:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T16:35:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T16:35:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T16:35:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T16:35:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T16:35:11.455 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T16:35:11.456 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T16:35:11.457 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T16:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T16:35:11.459 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T16:35:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T16:35:11.461 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T16:35:11.462 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T16:35:11.463 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T16:35:11.464 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================================================= 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout:Install 120 Packages 2023-07-29T16:35:11.465 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2023-07-29T16:35:11.466 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:35:11.466 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 194 M 2023-07-29T16:35:11.466 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-07-29T16:35:11.722 INFO:teuthology.orchestra.run.smithi151.stdout:(1/122): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 28 kB/s | 6.4 kB 00:00 2023-07-29T16:35:11.894 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:11.895 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:11.910 INFO:teuthology.orchestra.run.smithi098.stdout:(1/122): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 26 kB/s | 6.4 kB 00:00 2023-07-29T16:35:12.036 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-07-29T16:35:12.047 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================================================= 2023-07-29T16:35:12.047 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2023-07-29T16:35:12.047 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================================================= 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T16:35:12.048 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T16:35:12.049 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T16:35:12.050 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T16:35:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T16:35:12.052 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T16:35:12.053 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T16:35:12.054 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T16:35:12.055 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T16:35:12.056 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T16:35:12.057 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T16:35:12.058 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T16:35:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T16:35:12.060 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T16:35:12.061 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T16:35:12.062 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T16:35:12.063 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T16:35:12.064 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================================================= 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:Install 120 Packages 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 2 Packages 2023-07-29T16:35:12.065 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:35:12.066 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 194 M 2023-07-29T16:35:12.066 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2023-07-29T16:35:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:(2/122): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.3 MB/s | 847 kB 00:00 2023-07-29T16:35:12.506 INFO:teuthology.orchestra.run.smithi151.stdout:(3/122): ceph-immutable-object-cache-18.1.3-11. 1.1 MB/s | 165 kB 00:00 2023-07-29T16:35:12.577 INFO:teuthology.orchestra.run.smithi098.stdout:(2/122): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.2 MB/s | 847 kB 00:00 2023-07-29T16:35:12.719 INFO:teuthology.orchestra.run.smithi098.stdout:(3/122): ceph-immutable-object-cache-18.1.3-11. 1.1 MB/s | 165 kB 00:00 2023-07-29T16:35:12.804 INFO:teuthology.orchestra.run.smithi070.stdout:(1/122): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 24 kB/s | 6.4 kB 00:00 2023-07-29T16:35:13.247 INFO:teuthology.orchestra.run.smithi151.stdout:(4/122): ceph-base-18.1.3-11.g0484097b.el8.x86_ 3.1 MB/s | 5.4 MB 00:01 2023-07-29T16:35:13.473 INFO:teuthology.orchestra.run.smithi151.stdout:(5/122): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 2.4 MB/s | 2.3 MB 00:00 2023-07-29T16:35:13.612 INFO:teuthology.orchestra.run.smithi151.stdout:(6/122): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 4.3 MB/s | 1.5 MB 00:00 2023-07-29T16:35:13.621 INFO:teuthology.orchestra.run.smithi070.stdout:(2/122): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 1.0 MB/s | 847 kB 00:00 2023-07-29T16:35:13.644 INFO:teuthology.orchestra.run.smithi098.stdout:(4/122): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 2.5 MB/s | 2.3 MB 00:00 2023-07-29T16:35:13.821 INFO:teuthology.orchestra.run.smithi070.stdout:(3/122): ceph-immutable-object-cache-18.1.3-11. 828 kB/s | 165 kB 00:00 2023-07-29T16:35:14.217 INFO:teuthology.orchestra.run.smithi098.stdout:(5/122): ceph-base-18.1.3-11.g0484097b.el8.x86_ 2.1 MB/s | 5.4 MB 00:02 2023-07-29T16:35:14.253 INFO:teuthology.orchestra.run.smithi098.stdout:(6/122): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 2.5 MB/s | 1.5 MB 00:00 2023-07-29T16:35:14.784 INFO:teuthology.orchestra.run.smithi151.stdout:(7/122): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 3.5 MB/s | 4.6 MB 00:01 2023-07-29T16:35:15.271 INFO:teuthology.orchestra.run.smithi070.stdout:(4/122): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 1.6 MB/s | 2.3 MB 00:01 2023-07-29T16:35:15.562 INFO:teuthology.orchestra.run.smithi098.stdout:(7/122): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 3.4 MB/s | 4.6 MB 00:01 2023-07-29T16:35:15.679 INFO:teuthology.orchestra.run.smithi070.stdout:(5/122): ceph-base-18.1.3-11.g0484097b.el8.x86_ 1.7 MB/s | 5.4 MB 00:03 2023-07-29T16:35:15.817 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:15.818 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T16:35:15.963 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-07-29T16:35:15.975 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================================================= 2023-07-29T16:35:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2023-07-29T16:35:15.975 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================================================= 2023-07-29T16:35:15.975 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2023-07-29T16:35:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T16:35:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T16:35:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T16:35:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T16:35:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T16:35:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T16:35:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T16:35:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T16:35:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T16:35:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T16:35:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T16:35:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T16:35:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T16:35:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T16:35:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T16:35:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T16:35:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T16:35:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T16:35:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T16:35:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T16:35:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T16:35:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T16:35:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T16:35:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T16:35:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================================================= 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout:Install 120 Packages 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2023-07-29T16:35:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:35:15.996 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 194 M 2023-07-29T16:35:15.996 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2023-07-29T16:35:16.196 INFO:teuthology.orchestra.run.smithi070.stdout:(6/122): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 1.7 MB/s | 1.5 MB 00:00 2023-07-29T16:35:16.637 INFO:teuthology.orchestra.run.smithi102.stdout:(1/122): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 14 kB/s | 6.4 kB 00:00 2023-07-29T16:35:16.973 INFO:teuthology.orchestra.run.smithi151.stdout:(8/122): ceph-common-18.1.3-11.g0484097b.el8.x8 3.9 MB/s | 22 MB 00:05 2023-07-29T16:35:17.124 INFO:teuthology.orchestra.run.smithi151.stdout:(9/122): ceph-selinux-18.1.3-11.g0484097b.el8.x 162 kB/s | 24 kB 00:00 2023-07-29T16:35:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:(7/122): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 2.3 MB/s | 4.6 MB 00:02 2023-07-29T16:35:17.694 INFO:teuthology.orchestra.run.smithi098.stdout:(8/122): ceph-common-18.1.3-11.g0484097b.el8.x8 3.6 MB/s | 22 MB 00:06 2023-07-29T16:35:17.745 INFO:teuthology.orchestra.run.smithi102.stdout:(2/122): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 765 kB/s | 847 kB 00:01 2023-07-29T16:35:17.828 INFO:teuthology.orchestra.run.smithi098.stdout:(9/122): ceph-selinux-18.1.3-11.g0484097b.el8.x 181 kB/s | 24 kB 00:00 2023-07-29T16:35:17.954 INFO:teuthology.orchestra.run.smithi102.stdout:(3/122): ceph-immutable-object-cache-18.1.3-11. 795 kB/s | 165 kB 00:00 2023-07-29T16:35:18.541 INFO:teuthology.orchestra.run.smithi151.stdout:(10/122): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 3.6 MB/s | 18 MB 00:04 2023-07-29T16:35:18.691 INFO:teuthology.orchestra.run.smithi151.stdout:(11/122): ceph-radosgw-18.1.3-11.g0484097b.el8. 3.3 MB/s | 13 MB 00:03 2023-07-29T16:35:18.716 INFO:teuthology.orchestra.run.smithi151.stdout:(12/122): libcephfs-devel-18.1.3-11.g0484097b.e 174 kB/s | 30 kB 00:00 2023-07-29T16:35:18.833 INFO:teuthology.orchestra.run.smithi151.stdout:(13/122): libcephsqlite-18.1.3-11.g0484097b.el8 1.1 MB/s | 137 kB 00:00 2023-07-29T16:35:18.950 INFO:teuthology.orchestra.run.smithi151.stdout:(14/122): librados-devel-18.1.3-11.g0484097b.el 1.2 MB/s | 139 kB 00:00 2023-07-29T16:35:19.084 INFO:teuthology.orchestra.run.smithi151.stdout:(15/122): libcephfs2-18.1.3-11.g0484097b.el8.x8 1.9 MB/s | 769 kB 00:00 2023-07-29T16:35:19.140 INFO:teuthology.orchestra.run.smithi098.stdout:(10/122): ceph-radosgw-18.1.3-11.g0484097b.el8. 3.6 MB/s | 13 MB 00:03 2023-07-29T16:35:19.150 INFO:teuthology.orchestra.run.smithi151.stdout:(16/122): libradosstriper1-18.1.3-11.g0484097b. 2.3 MB/s | 474 kB 00:00 2023-07-29T16:35:19.245 INFO:teuthology.orchestra.run.smithi098.stdout:(11/122): libcephfs-devel-18.1.3-11.g0484097b.e 289 kB/s | 30 kB 00:00 2023-07-29T16:35:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:(17/122): python3-ceph-argparse-18.1.3-11.g0484 412 kB/s | 45 kB 00:00 2023-07-29T16:35:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:(18/122): python3-ceph-common-18.1.3-11.g048409 837 kB/s | 119 kB 00:00 2023-07-29T16:35:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:(19/122): python3-cephfs-18.1.3-11.g0484097b.el 1.6 MB/s | 190 kB 00:00 2023-07-29T16:35:19.546 INFO:teuthology.orchestra.run.smithi098.stdout:(12/122): libcephfs2-18.1.3-11.g0484097b.el8.x8 2.5 MB/s | 769 kB 00:00 2023-07-29T16:35:19.604 INFO:teuthology.orchestra.run.smithi102.stdout:(4/122): ceph-base-18.1.3-11.g0484097b.el8.x86_ 1.6 MB/s | 5.4 MB 00:03 2023-07-29T16:35:19.646 INFO:teuthology.orchestra.run.smithi098.stdout:(13/122): libcephsqlite-18.1.3-11.g0484097b.el8 1.3 MB/s | 137 kB 00:00 2023-07-29T16:35:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:(20/122): python3-rados-18.1.3-11.g0484097b.el8 2.0 MB/s | 371 kB 00:00 2023-07-29T16:35:19.755 INFO:teuthology.orchestra.run.smithi098.stdout:(14/122): librados-devel-18.1.3-11.g0484097b.el 1.3 MB/s | 139 kB 00:00 2023-07-29T16:35:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:(5/122): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 1.3 MB/s | 2.3 MB 00:01 2023-07-29T16:35:19.910 INFO:teuthology.orchestra.run.smithi151.stdout:(21/122): python3-rbd-18.1.3-11.g0484097b.el8.x 1.7 MB/s | 364 kB 00:00 2023-07-29T16:35:19.964 INFO:teuthology.orchestra.run.smithi098.stdout:(15/122): libradosstriper1-18.1.3-11.g0484097b. 2.2 MB/s | 474 kB 00:00 2023-07-29T16:35:20.019 INFO:teuthology.orchestra.run.smithi151.stdout:(22/122): python3-rgw-18.1.3-11.g0484097b.el8.x 984 kB/s | 107 kB 00:00 2023-07-29T16:35:20.127 INFO:teuthology.orchestra.run.smithi151.stdout:(23/122): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 873 kB/s | 94 kB 00:00 2023-07-29T16:35:20.338 INFO:teuthology.orchestra.run.smithi102.stdout:(6/122): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 2.1 MB/s | 1.5 MB 00:00 2023-07-29T16:35:21.544 INFO:teuthology.orchestra.run.smithi151.stdout:(24/122): librgw2-18.1.3-11.g0484097b.el8.x86_6 2.6 MB/s | 6.5 MB 00:02 2023-07-29T16:35:21.688 INFO:teuthology.orchestra.run.smithi151.stdout:(25/122): rbd-mirror-18.1.3-11.g0484097b.el8.x8 2.2 MB/s | 3.4 MB 00:01 2023-07-29T16:35:21.720 INFO:teuthology.orchestra.run.smithi151.stdout:(26/122): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.0 MB/s | 179 kB 00:00 2023-07-29T16:35:21.770 INFO:teuthology.orchestra.run.smithi151.stdout:(27/122): ceph-grafana-dashboards-18.1.3-11.g04 281 kB/s | 23 kB 00:00 2023-07-29T16:35:21.796 INFO:teuthology.orchestra.run.smithi151.stdout:(28/122): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.7 MB/s | 127 kB 00:00 2023-07-29T16:35:21.822 INFO:teuthology.orchestra.run.smithi098.stdout:(16/122): librgw2-18.1.3-11.g0484097b.el8.x86_6 3.5 MB/s | 6.5 MB 00:01 2023-07-29T16:35:21.906 INFO:teuthology.orchestra.run.smithi098.stdout:(17/122): python3-ceph-argparse-18.1.3-11.g0484 536 kB/s | 45 kB 00:00 2023-07-29T16:35:21.954 INFO:teuthology.orchestra.run.smithi070.stdout:(8/122): ceph-radosgw-18.1.3-11.g0484097b.el8.x 3.1 MB/s | 13 MB 00:04 2023-07-29T16:35:21.998 INFO:teuthology.orchestra.run.smithi098.stdout:(18/122): python3-ceph-common-18.1.3-11.g048409 1.3 MB/s | 119 kB 00:00 2023-07-29T16:35:22.054 INFO:teuthology.orchestra.run.smithi070.stdout:(9/122): ceph-selinux-18.1.3-11.g0484097b.el8.x 243 kB/s | 24 kB 00:00 2023-07-29T16:35:22.198 INFO:teuthology.orchestra.run.smithi098.stdout:(19/122): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 2.2 MB/s | 18 MB 00:07 2023-07-29T16:35:22.223 INFO:teuthology.orchestra.run.smithi098.stdout:(20/122): python3-cephfs-18.1.3-11.g0484097b.el 844 kB/s | 190 kB 00:00 2023-07-29T16:35:22.357 INFO:teuthology.orchestra.run.smithi098.stdout:(21/122): python3-rbd-18.1.3-11.g0484097b.el8.x 2.7 MB/s | 364 kB 00:00 2023-07-29T16:35:22.399 INFO:teuthology.orchestra.run.smithi098.stdout:(22/122): python3-rados-18.1.3-11.g0484097b.el8 1.8 MB/s | 371 kB 00:00 2023-07-29T16:35:22.421 INFO:teuthology.orchestra.run.smithi151.stdout:(29/122): ceph-mgr-dashboard-18.1.3-11.g0484097 2.6 MB/s | 1.7 MB 00:00 2023-07-29T16:35:22.466 INFO:teuthology.orchestra.run.smithi098.stdout:(23/122): python3-rgw-18.1.3-11.g0484097b.el8.x 982 kB/s | 107 kB 00:00 2023-07-29T16:35:22.491 INFO:teuthology.orchestra.run.smithi098.stdout:(24/122): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 1.0 MB/s | 94 kB 00:00 2023-07-29T16:35:22.633 INFO:teuthology.orchestra.run.smithi098.stdout:(25/122): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.2 MB/s | 179 kB 00:00 2023-07-29T16:35:22.718 INFO:teuthology.orchestra.run.smithi151.stdout:(30/122): ceph-mgr-modules-core-18.1.3-11.g0484 809 kB/s | 240 kB 00:00 2023-07-29T16:35:22.742 INFO:teuthology.orchestra.run.smithi098.stdout:(26/122): ceph-grafana-dashboards-18.1.3-11.g04 213 kB/s | 23 kB 00:00 2023-07-29T16:35:22.859 INFO:teuthology.orchestra.run.smithi098.stdout:(27/122): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.1 MB/s | 127 kB 00:00 2023-07-29T16:35:22.955 INFO:teuthology.orchestra.run.smithi151.stdout:(31/122): ceph-mgr-rook-18.1.3-11.g0484097b.el8 201 kB/s | 47 kB 00:00 2023-07-29T16:35:23.029 INFO:teuthology.orchestra.run.smithi102.stdout:(7/122): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 1.4 MB/s | 4.6 MB 00:03 2023-07-29T16:35:23.063 INFO:teuthology.orchestra.run.smithi151.stdout:(32/122): ceph-prometheus-alerts-18.1.3-11.g048 134 kB/s | 15 kB 00:00 2023-07-29T16:35:23.171 INFO:teuthology.orchestra.run.smithi070.stdout:(10/122): ceph-common-18.1.3-11.g0484097b.el8.x 2.0 MB/s | 22 MB 00:10 2023-07-29T16:35:23.264 INFO:teuthology.orchestra.run.smithi151.stdout:(33/122): ceph-volume-18.1.3-11.g0484097b.el8.n 1.3 MB/s | 258 kB 00:00 2023-07-29T16:35:23.288 INFO:teuthology.orchestra.run.smithi070.stdout:(11/122): libcephfs-devel-18.1.3-11.g0484097b.e 262 kB/s | 30 kB 00:00 2023-07-29T16:35:23.372 INFO:teuthology.orchestra.run.smithi151.stdout:(34/122): cephadm-18.1.3-11.g0484097b.el8.noarc 1.4 MB/s | 160 kB 00:00 2023-07-29T16:35:23.576 INFO:teuthology.orchestra.run.smithi098.stdout:(28/122): rbd-mirror-18.1.3-11.g0484097b.el8.x8 3.1 MB/s | 3.4 MB 00:01 2023-07-29T16:35:23.689 INFO:teuthology.orchestra.run.smithi151.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 969 kB/s | 306 kB 00:00 2023-07-29T16:35:23.693 INFO:teuthology.orchestra.run.smithi098.stdout:(29/122): ceph-mgr-dashboard-18.1.3-11.g0484097 2.0 MB/s | 1.7 MB 00:00 2023-07-29T16:35:23.773 INFO:teuthology.orchestra.run.smithi151.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 708 kB/s | 59 kB 00:00 2023-07-29T16:35:23.797 INFO:teuthology.orchestra.run.smithi070.stdout:(12/122): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 2.3 MB/s | 18 MB 00:07 2023-07-29T16:35:23.830 INFO:teuthology.orchestra.run.smithi070.stdout:(13/122): libcephfs2-18.1.3-11.g0484097b.el8.x8 1.4 MB/s | 769 kB 00:00 2023-07-29T16:35:23.857 INFO:teuthology.orchestra.run.smithi151.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 902 kB/s | 75 kB 00:00 2023-07-29T16:35:23.860 INFO:teuthology.orchestra.run.smithi098.stdout:(30/122): ceph-mgr-modules-core-18.1.3-11.g0484 1.4 MB/s | 240 kB 00:00 2023-07-29T16:35:23.930 INFO:teuthology.orchestra.run.smithi070.stdout:(14/122): librados-devel-18.1.3-11.g0484097b.el 1.4 MB/s | 139 kB 00:00 2023-07-29T16:35:23.960 INFO:teuthology.orchestra.run.smithi098.stdout:(31/122): ceph-mgr-rook-18.1.3-11.g0484097b.el8 474 kB/s | 47 kB 00:00 2023-07-29T16:35:23.981 INFO:teuthology.orchestra.run.smithi070.stdout:(15/122): libcephsqlite-18.1.3-11.g0484097b.el8 748 kB/s | 137 kB 00:00 2023-07-29T16:35:24.015 INFO:teuthology.orchestra.run.smithi151.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2023-07-29T16:35:24.052 INFO:teuthology.orchestra.run.smithi098.stdout:(32/122): ceph-prometheus-alerts-18.1.3-11.g048 158 kB/s | 15 kB 00:00 2023-07-29T16:35:24.132 INFO:teuthology.orchestra.run.smithi151.stdout:(39/122): ceph-mgr-diskprediction-local-18.1.3- 3.2 MB/s | 7.4 MB 00:02 2023-07-29T16:35:24.157 INFO:teuthology.orchestra.run.smithi151.stdout:(40/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2023-07-29T16:35:24.206 INFO:teuthology.orchestra.run.smithi070.stdout:(16/122): libradosstriper1-18.1.3-11.g0484097b. 1.7 MB/s | 474 kB 00:00 2023-07-29T16:35:24.244 INFO:teuthology.orchestra.run.smithi098.stdout:(33/122): ceph-volume-18.1.3-11.g0484097b.el8.n 1.3 MB/s | 258 kB 00:00 2023-07-29T16:35:24.258 INFO:teuthology.orchestra.run.smithi151.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2023-07-29T16:35:24.331 INFO:teuthology.orchestra.run.smithi070.stdout:(17/122): python3-ceph-argparse-18.1.3-11.g0484 357 kB/s | 45 kB 00:00 2023-07-29T16:35:24.336 INFO:teuthology.orchestra.run.smithi098.stdout:(34/122): cephadm-18.1.3-11.g0484097b.el8.noarc 1.7 MB/s | 160 kB 00:00 2023-07-29T16:35:24.341 INFO:teuthology.orchestra.run.smithi151.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-07-29T16:35:24.423 INFO:teuthology.orchestra.run.smithi070.stdout:(18/122): python3-ceph-common-18.1.3-11.g048409 1.3 MB/s | 119 kB 00:00 2023-07-29T16:35:24.425 INFO:teuthology.orchestra.run.smithi151.stdout:(43/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-07-29T16:35:24.508 INFO:teuthology.orchestra.run.smithi151.stdout:(44/122): python3-beautifulsoup4-4.6.3-2.el8.1. 493 kB/s | 185 kB 00:00 2023-07-29T16:35:24.532 INFO:teuthology.orchestra.run.smithi070.stdout:(19/122): python3-cephfs-18.1.3-11.g0484097b.el 1.7 MB/s | 190 kB 00:00 2023-07-29T16:35:24.534 INFO:teuthology.orchestra.run.smithi151.stdout:(45/122): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-07-29T16:35:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 684 kB/s | 81 kB 00:00 2023-07-29T16:35:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-07-29T16:35:24.716 INFO:teuthology.orchestra.run.smithi070.stdout:(20/122): python3-rados-18.1.3-11.g0484097b.el8 2.0 MB/s | 371 kB 00:00 2023-07-29T16:35:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 178 kB/s | 18 kB 00:00 2023-07-29T16:35:24.827 INFO:teuthology.orchestra.run.smithi151.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-07-29T16:35:24.927 INFO:teuthology.orchestra.run.smithi151.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2023-07-29T16:35:24.961 INFO:teuthology.orchestra.run.smithi151.stdout:(51/122): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2023-07-29T16:35:24.982 INFO:teuthology.orchestra.run.smithi070.stdout:(21/122): python3-rbd-18.1.3-11.g0484097b.el8.x 1.3 MB/s | 364 kB 00:00 2023-07-29T16:35:25.011 INFO:teuthology.orchestra.run.smithi151.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 720 kB/s | 60 kB 00:00 2023-07-29T16:35:25.066 INFO:teuthology.orchestra.run.smithi070.stdout:(22/122): python3-rgw-18.1.3-11.g0484097b.el8.x 1.3 MB/s | 107 kB 00:00 2023-07-29T16:35:25.086 INFO:teuthology.orchestra.run.smithi151.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-07-29T16:35:25.112 INFO:teuthology.orchestra.run.smithi151.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-07-29T16:35:25.158 INFO:teuthology.orchestra.run.smithi070.stdout:(23/122): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 1.0 MB/s | 94 kB 00:00 2023-07-29T16:35:25.162 INFO:teuthology.orchestra.run.smithi151.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-07-29T16:35:25.220 INFO:teuthology.orchestra.run.smithi098.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 347 kB/s | 306 kB 00:00 2023-07-29T16:35:25.220 INFO:teuthology.orchestra.run.smithi151.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-07-29T16:35:25.238 INFO:teuthology.orchestra.run.smithi151.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-07-29T16:35:25.305 INFO:teuthology.orchestra.run.smithi151.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-07-29T16:35:25.330 INFO:teuthology.orchestra.run.smithi151.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2023-07-29T16:35:25.337 INFO:teuthology.orchestra.run.smithi098.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 505 kB/s | 59 kB 00:00 2023-07-29T16:35:25.388 INFO:teuthology.orchestra.run.smithi151.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-07-29T16:35:25.412 INFO:teuthology.orchestra.run.smithi151.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-07-29T16:35:25.420 INFO:teuthology.orchestra.run.smithi098.stdout:(37/122): ceph-mgr-diskprediction-local-18.1.3- 4.0 MB/s | 7.4 MB 00:01 2023-07-29T16:35:25.454 INFO:teuthology.orchestra.run.smithi098.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 641 kB/s | 75 kB 00:00 2023-07-29T16:35:25.497 INFO:teuthology.orchestra.run.smithi151.stdout:(62/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-07-29T16:35:25.523 INFO:teuthology.orchestra.run.smithi151.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-07-29T16:35:25.571 INFO:teuthology.orchestra.run.smithi098.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2023-07-29T16:35:25.573 INFO:teuthology.orchestra.run.smithi151.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 816 kB/s | 61 kB 00:00 2023-07-29T16:35:25.607 INFO:teuthology.orchestra.run.smithi151.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-07-29T16:35:25.649 INFO:teuthology.orchestra.run.smithi151.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-07-29T16:35:25.665 INFO:teuthology.orchestra.run.smithi151.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 70 kB 00:00 2023-07-29T16:35:25.747 INFO:teuthology.orchestra.run.smithi098.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-07-29T16:35:25.888 INFO:teuthology.orchestra.run.smithi098.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 233 kB/s | 33 kB 00:00 2023-07-29T16:35:25.983 INFO:teuthology.orchestra.run.smithi151.stdout:(68/122): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-07-29T16:35:25.989 INFO:teuthology.orchestra.run.smithi098.stdout:(42/122): python3-asyncssh-2.7.0-2.el8.noarch.r 837 kB/s | 476 kB 00:00 2023-07-29T16:35:26.022 INFO:teuthology.orchestra.run.smithi098.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-07-29T16:35:26.024 INFO:teuthology.orchestra.run.smithi151.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 4.2 MB/s | 1.7 MB 00:00 2023-07-29T16:35:26.050 INFO:teuthology.orchestra.run.smithi151.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-07-29T16:35:26.089 INFO:teuthology.orchestra.run.smithi098.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-07-29T16:35:26.116 INFO:teuthology.orchestra.run.smithi151.stdout:(71/122): python3-pytz-2017.2-9.el8.noarch.rpm 590 kB/s | 54 kB 00:00 2023-07-29T16:35:26.142 INFO:teuthology.orchestra.run.smithi151.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.9 MB/s | 259 kB 00:00 2023-07-29T16:35:26.167 INFO:teuthology.orchestra.run.smithi151.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-07-29T16:35:26.192 INFO:teuthology.orchestra.run.smithi151.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 771 kB/s | 39 kB 00:00 2023-07-29T16:35:26.198 INFO:teuthology.orchestra.run.smithi098.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 749 kB/s | 81 kB 00:00 2023-07-29T16:35:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-07-29T16:35:26.241 INFO:teuthology.orchestra.run.smithi070.stdout:(24/122): librgw2-18.1.3-11.g0484097b.el8.x86_6 2.9 MB/s | 6.5 MB 00:02 2023-07-29T16:35:26.265 INFO:teuthology.orchestra.run.smithi098.stdout:(46/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-07-29T16:35:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-07-29T16:35:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-29T16:35:26.308 INFO:teuthology.orchestra.run.smithi070.stdout:(25/122): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 2.6 MB/s | 179 kB 00:00 2023-07-29T16:35:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-07-29T16:35:26.349 INFO:teuthology.orchestra.run.smithi098.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-07-29T16:35:26.366 INFO:teuthology.orchestra.run.smithi098.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-07-29T16:35:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-07-29T16:35:26.383 INFO:teuthology.orchestra.run.smithi070.stdout:(26/122): ceph-grafana-dashboards-18.1.3-11.g04 307 kB/s | 23 kB 00:00 2023-07-29T16:35:26.396 INFO:teuthology.orchestra.run.smithi102.stdout:(8/122): ceph-osd-18.1.3-11.g0484097b.el8.x86_6 2.9 MB/s | 18 MB 00:06 2023-07-29T16:35:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 528 kB/s | 27 kB 00:00 2023-07-29T16:35:26.458 INFO:teuthology.orchestra.run.smithi098.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-07-29T16:35:26.475 INFO:teuthology.orchestra.run.smithi070.stdout:(27/122): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.4 MB/s | 127 kB 00:00 2023-07-29T16:35:26.488 INFO:teuthology.orchestra.run.smithi102.stdout:(9/122): ceph-selinux-18.1.3-11.g0484097b.el8.x 266 kB/s | 24 kB 00:00 2023-07-29T16:35:26.503 INFO:teuthology.orchestra.run.smithi151.stdout:(81/122): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-07-29T16:35:26.528 INFO:teuthology.orchestra.run.smithi151.stdout:(82/122): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2023-07-29T16:35:26.549 INFO:teuthology.orchestra.run.smithi098.stdout:(50/122): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-07-29T16:35:26.553 INFO:teuthology.orchestra.run.smithi151.stdout:(83/122): python3-prettytable-0.7.2-14.el8.noar 876 kB/s | 44 kB 00:00 2023-07-29T16:35:26.566 INFO:teuthology.orchestra.run.smithi098.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-07-29T16:35:26.618 INFO:teuthology.orchestra.run.smithi070.stdout:(28/122): rbd-mirror-18.1.3-11.g0484097b.el8.x8 2.4 MB/s | 3.4 MB 00:01 2023-07-29T16:35:26.620 INFO:teuthology.orchestra.run.smithi151.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-07-29T16:35:26.642 INFO:teuthology.orchestra.run.smithi098.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-07-29T16:35:26.679 INFO:teuthology.orchestra.run.smithi151.stdout:(85/122): python3-numpy-1.14.3-10.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2023-07-29T16:35:26.696 INFO:teuthology.orchestra.run.smithi151.stdout:(86/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.9 MB/s | 225 kB 00:00 2023-07-29T16:35:26.717 INFO:teuthology.orchestra.run.smithi098.stdout:(53/122): python3-portend-2.6-1.el8.noarch.rpm 208 kB/s | 16 kB 00:00 2023-07-29T16:35:26.730 INFO:teuthology.orchestra.run.smithi151.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-07-29T16:35:26.742 INFO:teuthology.orchestra.run.smithi098.stdout:(54/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-07-29T16:35:26.755 INFO:teuthology.orchestra.run.smithi151.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2023-07-29T16:35:26.780 INFO:teuthology.orchestra.run.smithi151.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-29T16:35:26.822 INFO:teuthology.orchestra.run.smithi151.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-29T16:35:26.843 INFO:teuthology.orchestra.run.smithi098.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-07-29T16:35:26.927 INFO:teuthology.orchestra.run.smithi098.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-07-29T16:35:26.952 INFO:teuthology.orchestra.run.smithi098.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 591 kB/s | 64 kB 00:00 2023-07-29T16:35:26.972 INFO:teuthology.orchestra.run.smithi151.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 25 MB/s | 4.9 MB 00:00 2023-07-29T16:35:27.001 INFO:teuthology.orchestra.run.smithi070.stdout:(29/122): ceph-mgr-dashboard-18.1.3-11.g0484097 3.2 MB/s | 1.7 MB 00:00 2023-07-29T16:35:27.019 INFO:teuthology.orchestra.run.smithi098.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-07-29T16:35:27.044 INFO:teuthology.orchestra.run.smithi098.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2023-07-29T16:35:27.056 INFO:teuthology.orchestra.run.smithi151.stdout:(92/122): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-07-29T16:35:27.082 INFO:teuthology.orchestra.run.smithi151.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-07-29T16:35:27.103 INFO:teuthology.orchestra.run.smithi098.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-07-29T16:35:27.106 INFO:teuthology.orchestra.run.smithi151.stdout:(94/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-29T16:35:27.128 INFO:teuthology.orchestra.run.smithi098.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2023-07-29T16:35:27.132 INFO:teuthology.orchestra.run.smithi151.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 934 kB/s | 47 kB 00:00 2023-07-29T16:35:27.152 INFO:teuthology.orchestra.run.smithi070.stdout:(30/122): ceph-mgr-modules-core-18.1.3-11.g0484 1.6 MB/s | 240 kB 00:00 2023-07-29T16:35:27.157 INFO:teuthology.orchestra.run.smithi151.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-07-29T16:35:27.183 INFO:teuthology.orchestra.run.smithi151.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-07-29T16:35:27.200 INFO:teuthology.orchestra.run.smithi151.stdout:(98/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-07-29T16:35:27.212 INFO:teuthology.orchestra.run.smithi098.stdout:(62/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-07-29T16:35:27.225 INFO:teuthology.orchestra.run.smithi151.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-07-29T16:35:27.242 INFO:teuthology.orchestra.run.smithi151.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-07-29T16:35:27.243 INFO:teuthology.orchestra.run.smithi070.stdout:(31/122): ceph-mgr-rook-18.1.3-11.g0484097b.el8 518 kB/s | 47 kB 00:00 2023-07-29T16:35:27.245 INFO:teuthology.orchestra.run.smithi098.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2023-07-29T16:35:27.267 INFO:teuthology.orchestra.run.smithi151.stdout:(101/122): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-07-29T16:35:27.292 INFO:teuthology.orchestra.run.smithi151.stdout:(102/122): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-29T16:35:27.317 INFO:teuthology.orchestra.run.smithi151.stdout:(103/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-07-29T16:35:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:(32/122): ceph-prometheus-alerts-18.1.3-11.g048 174 kB/s | 15 kB 00:00 2023-07-29T16:35:27.337 INFO:teuthology.orchestra.run.smithi098.stdout:(64/122): python3-webtest-2.0.33-1.el8.noarch.r 931 kB/s | 85 kB 00:00 2023-07-29T16:35:27.351 INFO:teuthology.orchestra.run.smithi151.stdout:(104/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-07-29T16:35:27.371 INFO:teuthology.orchestra.run.smithi098.stdout:(65/122): python3-websocket-client-0.56.0-5.el8 384 kB/s | 61 kB 00:00 2023-07-29T16:35:27.376 INFO:teuthology.orchestra.run.smithi151.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-07-29T16:35:27.402 INFO:teuthology.orchestra.run.smithi151.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-29T16:35:27.422 INFO:teuthology.orchestra.run.smithi098.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 273 kB/s | 23 kB 00:00 2023-07-29T16:35:27.435 INFO:teuthology.orchestra.run.smithi151.stdout:(107/122): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-07-29T16:35:27.447 INFO:teuthology.orchestra.run.smithi098.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-29T16:35:27.452 INFO:teuthology.orchestra.run.smithi151.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-07-29T16:35:27.486 INFO:teuthology.orchestra.run.smithi070.stdout:(33/122): ceph-volume-18.1.3-11.g0484097b.el8.n 1.6 MB/s | 258 kB 00:00 2023-07-29T16:35:27.497 INFO:teuthology.orchestra.run.smithi098.stdout:(68/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 943 kB/s | 47 kB 00:00 2023-07-29T16:35:27.511 INFO:teuthology.orchestra.run.smithi151.stdout:(109/122): pcre2-devel-10.32-2.el8.x86_64.rpm 7.8 MB/s | 605 kB 00:00 2023-07-29T16:35:27.536 INFO:teuthology.orchestra.run.smithi151.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-07-29T16:35:27.539 INFO:teuthology.orchestra.run.smithi098.stdout:(69/122): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-07-29T16:35:27.569 INFO:teuthology.orchestra.run.smithi070.stdout:(34/122): cephadm-18.1.3-11.g0484097b.el8.noarc 1.9 MB/s | 160 kB 00:00 2023-07-29T16:35:27.606 INFO:teuthology.orchestra.run.smithi098.stdout:(70/122): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-07-29T16:35:27.630 INFO:teuthology.orchestra.run.smithi102.stdout:(10/122): ceph-common-18.1.3-11.g0484097b.el8.x 1.9 MB/s | 22 MB 00:11 2023-07-29T16:35:27.631 INFO:teuthology.orchestra.run.smithi098.stdout:(71/122): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-07-29T16:35:27.673 INFO:teuthology.orchestra.run.smithi098.stdout:(72/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.3 MB/s | 48 kB 00:00 2023-07-29T16:35:27.697 INFO:teuthology.orchestra.run.smithi102.stdout:(11/122): libcephfs-devel-18.1.3-11.g0484097b.e 457 kB/s | 30 kB 00:00 2023-07-29T16:35:27.698 INFO:teuthology.orchestra.run.smithi098.stdout:(73/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2023-07-29T16:35:27.724 INFO:teuthology.orchestra.run.smithi098.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-29T16:35:27.749 INFO:teuthology.orchestra.run.smithi098.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 851 kB/s | 43 kB 00:00 2023-07-29T16:35:27.774 INFO:teuthology.orchestra.run.smithi098.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-29T16:35:27.800 INFO:teuthology.orchestra.run.smithi098.stdout:(77/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-07-29T16:35:27.833 INFO:teuthology.orchestra.run.smithi098.stdout:(78/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-07-29T16:35:27.861 INFO:teuthology.orchestra.run.smithi070.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-07-29T16:35:27.884 INFO:teuthology.orchestra.run.smithi098.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 224 kB/s | 19 kB 00:00 2023-07-29T16:35:27.909 INFO:teuthology.orchestra.run.smithi098.stdout:(80/122): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-07-29T16:35:27.922 INFO:teuthology.orchestra.run.smithi102.stdout:(12/122): libcephfs2-18.1.3-11.g0484097b.el8.x8 3.3 MB/s | 769 kB 00:00 2023-07-29T16:35:27.936 INFO:teuthology.orchestra.run.smithi070.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 785 kB/s | 59 kB 00:00 2023-07-29T16:35:27.951 INFO:teuthology.orchestra.run.smithi098.stdout:(81/122): python3-cryptography-3.2.1-5.el8.x86_ 8.2 MB/s | 559 kB 00:00 2023-07-29T16:35:27.962 INFO:teuthology.orchestra.run.smithi151.stdout:(111/122): ceph-test-18.1.3-11.g0484097b.el8.x8 4.3 MB/s | 47 MB 00:10 2023-07-29T16:35:27.968 INFO:teuthology.orchestra.run.smithi098.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-07-29T16:35:27.998 INFO:teuthology.orchestra.run.smithi102.stdout:(13/122): libcephsqlite-18.1.3-11.g0484097b.el8 1.8 MB/s | 137 kB 00:00 2023-07-29T16:35:28.002 INFO:teuthology.orchestra.run.smithi098.stdout:(83/122): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-29T16:35:28.003 INFO:teuthology.orchestra.run.smithi070.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-07-29T16:35:28.012 INFO:teuthology.orchestra.run.smithi151.stdout:(112/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 4.6 MB/s | 2.3 MB 00:00 2023-07-29T16:35:28.027 INFO:teuthology.orchestra.run.smithi098.stdout:(84/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-07-29T16:35:28.046 INFO:teuthology.orchestra.run.smithi151.stdout:(113/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 142 kB/s | 72 kB 00:00 2023-07-29T16:35:28.065 INFO:teuthology.orchestra.run.smithi102.stdout:(14/122): librados-devel-18.1.3-11.g0484097b.el 2.0 MB/s | 139 kB 00:00 2023-07-29T16:35:28.069 INFO:teuthology.orchestra.run.smithi098.stdout:(85/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-07-29T16:35:28.104 INFO:teuthology.orchestra.run.smithi151.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 693 kB/s | 60 kB 00:00 2023-07-29T16:35:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-07-29T16:35:28.128 INFO:teuthology.orchestra.run.smithi098.stdout:(86/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 19 MB/s | 2.3 MB 00:00 2023-07-29T16:35:28.130 INFO:teuthology.orchestra.run.smithi151.stdout:(115/122): fuse-2.9.7-15.el8.x86_64.rpm 495 kB/s | 83 kB 00:00 2023-07-29T16:35:28.155 INFO:teuthology.orchestra.run.smithi151.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-29T16:35:28.178 INFO:teuthology.orchestra.run.smithi098.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 763 kB/s | 83 kB 00:00 2023-07-29T16:35:28.179 INFO:teuthology.orchestra.run.smithi070.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 655 kB/s | 44 kB 00:00 2023-07-29T16:35:28.180 INFO:teuthology.orchestra.run.smithi151.stdout:(117/122): libuuid-devel-2.32.1-35.el8.x86_64.r 734 kB/s | 98 kB 00:00 2023-07-29T16:35:28.203 INFO:teuthology.orchestra.run.smithi098.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 797 kB/s | 60 kB 00:00 2023-07-29T16:35:28.205 INFO:teuthology.orchestra.run.smithi151.stdout:(118/122): libcom_err-devel-1.45.6-4.el8.x86_64 513 kB/s | 39 kB 00:00 2023-07-29T16:35:28.223 INFO:teuthology.orchestra.run.smithi102.stdout:(15/122): libradosstriper1-18.1.3-11.g0484097b. 2.9 MB/s | 474 kB 00:00 2023-07-29T16:35:28.228 INFO:teuthology.orchestra.run.smithi098.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-07-29T16:35:28.231 INFO:teuthology.orchestra.run.smithi151.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 171 kB 00:00 2023-07-29T16:35:28.246 INFO:teuthology.orchestra.run.smithi070.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-07-29T16:35:28.254 INFO:teuthology.orchestra.run.smithi098.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-29T16:35:28.279 INFO:teuthology.orchestra.run.smithi098.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-07-29T16:35:28.315 INFO:teuthology.orchestra.run.smithi098.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 10 MB/s | 644 kB 00:00 2023-07-29T16:35:28.321 INFO:teuthology.orchestra.run.smithi070.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 440 kB/s | 33 kB 00:00 2023-07-29T16:35:28.348 INFO:teuthology.orchestra.run.smithi098.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.4 MB/s | 171 kB 00:00 2023-07-29T16:35:28.356 INFO:teuthology.orchestra.run.smithi151.stdout:(120/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.1 MB/s | 644 kB 00:00 2023-07-29T16:35:28.388 INFO:teuthology.orchestra.run.smithi070.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-07-29T16:35:28.390 INFO:teuthology.orchestra.run.smithi098.stdout:(94/122): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-29T16:35:28.424 INFO:teuthology.orchestra.run.smithi098.stdout:(95/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-29T16:35:28.464 INFO:teuthology.orchestra.run.smithi070.stdout:(43/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.3 MB/s | 173 kB 00:00 2023-07-29T16:35:28.483 INFO:teuthology.orchestra.run.smithi098.stdout:(96/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-07-29T16:35:28.525 INFO:teuthology.orchestra.run.smithi098.stdout:(97/122): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-29T16:35:28.547 INFO:teuthology.orchestra.run.smithi070.stdout:(44/122): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-07-29T16:35:28.558 INFO:teuthology.orchestra.run.smithi098.stdout:(98/122): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-29T16:35:28.608 INFO:teuthology.orchestra.run.smithi098.stdout:(99/122): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-07-29T16:35:28.622 INFO:teuthology.orchestra.run.smithi070.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-07-29T16:35:28.651 INFO:teuthology.orchestra.run.smithi098.stdout:(100/122): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-07-29T16:35:28.690 INFO:teuthology.orchestra.run.smithi070.stdout:(46/122): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-29T16:35:28.692 INFO:teuthology.orchestra.run.smithi098.stdout:(101/122): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-29T16:35:28.757 INFO:teuthology.orchestra.run.smithi070.stdout:(47/122): python3-jaraco-functools-2.0-4.el8.no 264 kB/s | 18 kB 00:00 2023-07-29T16:35:28.758 INFO:teuthology.orchestra.run.smithi098.stdout:(102/122): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-07-29T16:35:28.910 INFO:teuthology.orchestra.run.smithi098.stdout:(103/122): python3-scipy-1.0.0-21.module+el8.5. 23 MB/s | 14 MB 00:00 2023-07-29T16:35:28.923 INFO:teuthology.orchestra.run.smithi070.stdout:(48/122): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-07-29T16:35:28.943 INFO:teuthology.orchestra.run.smithi098.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 3.8 MB/s | 713 kB 00:00 2023-07-29T16:35:28.999 INFO:teuthology.orchestra.run.smithi070.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 651 kB/s | 49 kB 00:00 2023-07-29T16:35:29.141 INFO:teuthology.orchestra.run.smithi070.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 414 kB/s | 59 kB 00:00 2023-07-29T16:35:29.219 INFO:teuthology.orchestra.run.smithi098.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 96 kB/s | 27 kB 00:00 2023-07-29T16:35:29.261 INFO:teuthology.orchestra.run.smithi098.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-29T16:35:29.264 INFO:teuthology.orchestra.run.smithi151.stdout:(121/122): librados2-18.1.3-11.g0484097b.el8.x8 3.5 MB/s | 3.7 MB 00:01 2023-07-29T16:35:29.265 INFO:teuthology.orchestra.run.smithi102.stdout:(16/122): ceph-radosgw-18.1.3-11.g0484097b.el8. 2.1 MB/s | 13 MB 00:06 2023-07-29T16:35:29.286 INFO:teuthology.orchestra.run.smithi098.stdout:(107/122): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-07-29T16:35:29.357 INFO:teuthology.orchestra.run.smithi102.stdout:(17/122): python3-ceph-argparse-18.1.3-11.g0484 489 kB/s | 45 kB 00:00 2023-07-29T16:35:29.361 INFO:teuthology.orchestra.run.smithi098.stdout:(108/122): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-07-29T16:35:29.399 INFO:teuthology.orchestra.run.smithi070.stdout:(51/122): ceph-mgr-diskprediction-local-18.1.3- 2.7 MB/s | 7.4 MB 00:02 2023-07-29T16:35:29.420 INFO:teuthology.orchestra.run.smithi098.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-07-29T16:35:29.424 INFO:teuthology.orchestra.run.smithi070.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 212 kB/s | 60 kB 00:00 2023-07-29T16:35:29.432 INFO:teuthology.orchestra.run.smithi102.stdout:(18/122): python3-ceph-common-18.1.3-11.g048409 1.5 MB/s | 119 kB 00:00 2023-07-29T16:35:29.462 INFO:teuthology.orchestra.run.smithi098.stdout:(110/122): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-07-29T16:35:29.483 INFO:teuthology.orchestra.run.smithi070.stdout:(53/122): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-07-29T16:35:29.490 INFO:teuthology.orchestra.run.smithi151.stdout:(122/122): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.8 MB/s | 3.6 MB 00:01 2023-07-29T16:35:29.492 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:35:29.493 INFO:teuthology.orchestra.run.smithi151.stdout:Total 11 MB/s | 194 MB 00:18 2023-07-29T16:35:29.529 INFO:teuthology.orchestra.run.smithi098.stdout:(111/122): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-07-29T16:35:29.554 INFO:teuthology.orchestra.run.smithi098.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.3 MB/s | 126 kB 00:00 2023-07-29T16:35:29.558 INFO:teuthology.orchestra.run.smithi070.stdout:(54/122): python3-repoze-lru-0.7-6.el8.noarch.r 449 kB/s | 34 kB 00:00 2023-07-29T16:35:29.580 INFO:teuthology.orchestra.run.smithi098.stdout:(113/122): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-07-29T16:35:29.583 INFO:teuthology.orchestra.run.smithi102.stdout:(19/122): python3-cephfs-18.1.3-11.g0484097b.el 1.2 MB/s | 190 kB 00:00 2023-07-29T16:35:29.605 INFO:teuthology.orchestra.run.smithi098.stdout:(114/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-07-29T16:35:29.638 INFO:teuthology.orchestra.run.smithi098.stdout:(115/122): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-07-29T16:35:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:(55/122): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-07-29T16:35:29.751 INFO:teuthology.orchestra.run.smithi070.stdout:(56/122): python3-rsa-4.9-2.el8.noarch.rpm 771 kB/s | 64 kB 00:00 2023-07-29T16:35:29.764 INFO:teuthology.orchestra.run.smithi098.stdout:(116/122): openblas-threads-0.3.15-3.el8.x86_64 31 MB/s | 4.9 MB 00:00 2023-07-29T16:35:29.809 INFO:teuthology.orchestra.run.smithi070.stdout:(57/122): python3-simplegeneric-0.8.1-17.el8.no 321 kB/s | 19 kB 00:00 2023-07-29T16:35:29.835 INFO:teuthology.orchestra.run.smithi070.stdout:(58/122): python3-pecan-1.3.2-9.el8.noarch.rpm 650 kB/s | 283 kB 00:00 2023-07-29T16:35:29.839 INFO:teuthology.orchestra.run.smithi098.stdout:(117/122): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-07-29T16:35:29.841 INFO:teuthology.orchestra.run.smithi102.stdout:(20/122): librgw2-18.1.3-11.g0484097b.el8.x86_6 4.0 MB/s | 6.5 MB 00:01 2023-07-29T16:35:29.865 INFO:teuthology.orchestra.run.smithi098.stdout:(118/122): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-07-29T16:35:29.867 INFO:teuthology.orchestra.run.smithi102.stdout:(21/122): python3-rados-18.1.3-11.g0484097b.el8 1.3 MB/s | 371 kB 00:00 2023-07-29T16:35:29.890 INFO:teuthology.orchestra.run.smithi098.stdout:(119/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-29T16:35:29.893 INFO:teuthology.orchestra.run.smithi070.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2023-07-29T16:35:29.936 INFO:teuthology.orchestra.run.smithi070.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-07-29T16:35:29.994 INFO:teuthology.orchestra.run.smithi070.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2023-07-29T16:35:30.034 INFO:teuthology.orchestra.run.smithi102.stdout:(22/122): python3-rgw-18.1.3-11.g0484097b.el8.x 641 kB/s | 107 kB 00:00 2023-07-29T16:35:30.102 INFO:teuthology.orchestra.run.smithi070.stdout:(62/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-07-29T16:35:30.117 INFO:teuthology.orchestra.run.smithi102.stdout:(23/122): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 1.1 MB/s | 94 kB 00:00 2023-07-29T16:35:30.161 INFO:teuthology.orchestra.run.smithi070.stdout:(63/122): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-07-29T16:35:30.208 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-07-29T16:35:30.220 INFO:teuthology.orchestra.run.smithi070.stdout:(64/122): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-07-29T16:35:30.245 INFO:teuthology.orchestra.run.smithi070.stdout:(65/122): python3-waitress-1.4.3-1.el8.noarch.r 826 kB/s | 255 kB 00:00 2023-07-29T16:35:30.279 INFO:teuthology.orchestra.run.smithi070.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 392 kB/s | 23 kB 00:00 2023-07-29T16:35:30.304 INFO:teuthology.orchestra.run.smithi070.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-29T16:35:30.307 INFO:teuthology.orchestra.run.smithi102.stdout:(24/122): python3-rbd-18.1.3-11.g0484097b.el8.x 781 kB/s | 364 kB 00:00 2023-07-29T16:35:30.321 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-07-29T16:35:30.321 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-07-29T16:35:30.354 INFO:teuthology.orchestra.run.smithi070.stdout:(68/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 941 kB/s | 47 kB 00:00 2023-07-29T16:35:30.396 INFO:teuthology.orchestra.run.smithi070.stdout:(69/122): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-07-29T16:35:30.430 INFO:teuthology.orchestra.run.smithi070.stdout:(70/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-07-29T16:35:30.468 INFO:teuthology.orchestra.run.smithi102.stdout:(25/122): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.1 MB/s | 179 kB 00:00 2023-07-29T16:35:30.472 INFO:teuthology.orchestra.run.smithi070.stdout:(71/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-07-29T16:35:30.505 INFO:teuthology.orchestra.run.smithi070.stdout:(72/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-07-29T16:35:30.539 INFO:teuthology.orchestra.run.smithi070.stdout:(73/122): libsepol-devel-2.9-3.el8.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2023-07-29T16:35:30.560 INFO:teuthology.orchestra.run.smithi102.stdout:(26/122): ceph-grafana-dashboards-18.1.3-11.g04 252 kB/s | 23 kB 00:00 2023-07-29T16:35:30.590 INFO:teuthology.orchestra.run.smithi070.stdout:(74/122): python3-requests-oauthlib-1.0.0-1.el8 853 kB/s | 43 kB 00:00 2023-07-29T16:35:30.631 INFO:teuthology.orchestra.run.smithi070.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-07-29T16:35:30.643 INFO:teuthology.orchestra.run.smithi102.stdout:(27/122): ceph-mgr-cephadm-18.1.3-11.g0484097b. 1.5 MB/s | 127 kB 00:00 2023-07-29T16:35:30.673 INFO:teuthology.orchestra.run.smithi070.stdout:(76/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-07-29T16:35:30.715 INFO:teuthology.orchestra.run.smithi070.stdout:(77/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 13 MB/s | 560 kB 00:00 2023-07-29T16:35:30.757 INFO:teuthology.orchestra.run.smithi070.stdout:(78/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 450 kB/s | 19 kB 00:00 2023-07-29T16:35:30.799 INFO:teuthology.orchestra.run.smithi070.stdout:(79/122): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-07-29T16:35:30.841 INFO:teuthology.orchestra.run.smithi070.stdout:(80/122): python3-cryptography-3.2.1-5.el8.x86_ 13 MB/s | 559 kB 00:00 2023-07-29T16:35:30.875 INFO:teuthology.orchestra.run.smithi070.stdout:(81/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 537 kB/s | 18 kB 00:00 2023-07-29T16:35:30.890 INFO:teuthology.orchestra.run.smithi098.stdout:(120/122): librbd1-18.1.3-11.g0484097b.el8.x86_ 3.6 MB/s | 3.6 MB 00:01 2023-07-29T16:35:30.917 INFO:teuthology.orchestra.run.smithi070.stdout:(82/122): pcre2-devel-10.32-2.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-07-29T16:35:30.959 INFO:teuthology.orchestra.run.smithi070.stdout:(83/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.5 MB/s | 238 kB 00:00 2023-07-29T16:35:31.040 INFO:teuthology.orchestra.run.smithi098.stdout:(121/122): librados2-18.1.3-11.g0484097b.el8.x8 3.1 MB/s | 3.7 MB 00:01 2023-07-29T16:35:31.059 INFO:teuthology.orchestra.run.smithi070.stdout:(84/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 23 MB/s | 2.3 MB 00:00 2023-07-29T16:35:31.093 INFO:teuthology.orchestra.run.smithi070.stdout:(85/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.1 MB/s | 72 kB 00:00 2023-07-29T16:35:31.127 INFO:teuthology.orchestra.run.smithi070.stdout:(86/122): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-07-29T16:35:31.160 INFO:teuthology.orchestra.run.smithi070.stdout:(87/122): elfutils-libelf-devel-0.186-1.el8.x86 1.8 MB/s | 60 kB 00:00 2023-07-29T16:35:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:(88/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.9 MB/s | 98 kB 00:00 2023-07-29T16:35:31.227 INFO:teuthology.orchestra.run.smithi070.stdout:(89/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-07-29T16:35:31.261 INFO:teuthology.orchestra.run.smithi070.stdout:(90/122): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-07-29T16:35:31.268 INFO:teuthology.orchestra.run.smithi102.stdout:(28/122): ceph-mgr-dashboard-18.1.3-11.g0484097 2.7 MB/s | 1.7 MB 00:00 2023-07-29T16:35:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:(91/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 15 MB/s | 644 kB 00:00 2023-07-29T16:35:31.342 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-07-29T16:35:31.345 INFO:teuthology.orchestra.run.smithi070.stdout:(92/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-07-29T16:35:31.346 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-07-29T16:35:31.629 INFO:teuthology.orchestra.run.smithi070.stdout:(93/122): python3-scipy-1.0.0-21.module+el8.5.0 48 MB/s | 14 MB 00:00 2023-07-29T16:35:31.670 INFO:teuthology.orchestra.run.smithi070.stdout:(94/122): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-29T16:35:31.704 INFO:teuthology.orchestra.run.smithi070.stdout:(95/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-29T16:35:31.746 INFO:teuthology.orchestra.run.smithi070.stdout:(96/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-29T16:35:31.788 INFO:teuthology.orchestra.run.smithi070.stdout:(97/122): socat-1.7.4.1-1.el8.x86_64.rpm 7.5 MB/s | 323 kB 00:00 2023-07-29T16:35:31.799 INFO:teuthology.orchestra.run.smithi098.stdout:(122/122): ceph-test-18.1.3-11.g0484097b.el8.x8 3.3 MB/s | 47 MB 00:13 2023-07-29T16:35:31.802 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:35:31.803 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.5 MB/s | 194 MB 00:20 2023-07-29T16:35:31.822 INFO:teuthology.orchestra.run.smithi070.stdout:(98/122): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-29T16:35:31.863 INFO:teuthology.orchestra.run.smithi070.stdout:(99/122): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-07-29T16:35:31.922 INFO:teuthology.orchestra.run.smithi070.stdout:(100/122): python3-jinja2-2.10.1-3.el8.noarch.r 9.0 MB/s | 538 kB 00:00 2023-07-29T16:35:31.956 INFO:teuthology.orchestra.run.smithi070.stdout:(101/122): python3-mako-1.0.6-13.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2023-07-29T16:35:31.989 INFO:teuthology.orchestra.run.smithi070.stdout:(102/122): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-07-29T16:35:32.031 INFO:teuthology.orchestra.run.smithi070.stdout:(103/122): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-07-29T16:35:32.149 INFO:teuthology.orchestra.run.smithi070.stdout:(104/122): python3-babel-2.5.1-7.el8.noarch.rpm 41 MB/s | 4.8 MB 00:00 2023-07-29T16:35:32.174 INFO:teuthology.orchestra.run.smithi070.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-07-29T16:35:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-29T16:35:32.244 INFO:teuthology.orchestra.run.smithi070.stdout:(107/122): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-07-29T16:35:32.375 INFO:teuthology.orchestra.run.smithi070.stdout:(108/122): python3-numpy-1.14.3-10.el8.x86_64.r 28 MB/s | 3.7 MB 00:00 2023-07-29T16:35:32.417 INFO:teuthology.orchestra.run.smithi070.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-07-29T16:35:32.459 INFO:teuthology.orchestra.run.smithi070.stdout:(110/122): python3-numpy-f2py-1.14.3-10.el8.x86 5.2 MB/s | 225 kB 00:00 2023-07-29T16:35:32.501 INFO:teuthology.orchestra.run.smithi070.stdout:(111/122): thrift-0.13.0-2.el8.x86_64.rpm 787 kB/s | 1.7 MB 00:02 2023-07-29T16:35:32.526 INFO:teuthology.orchestra.run.smithi070.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.8 MB/s | 126 kB 00:00 2023-07-29T16:35:32.528 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-07-29T16:35:32.568 INFO:teuthology.orchestra.run.smithi070.stdout:(113/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.8 MB/s | 103 kB 00:00 2023-07-29T16:35:32.573 INFO:teuthology.orchestra.run.smithi102.stdout:(29/122): rbd-mirror-18.1.3-11.g0484097b.el8.x8 1.4 MB/s | 3.4 MB 00:02 2023-07-29T16:35:32.593 INFO:teuthology.orchestra.run.smithi070.stdout:(114/122): python3-jsonpointer-1.10-11.el8.noar 217 kB/s | 20 kB 00:00 2023-07-29T16:35:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:(115/122): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-29T16:35:32.638 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-07-29T16:35:32.639 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-07-29T16:35:32.778 INFO:teuthology.orchestra.run.smithi102.stdout:(30/122): ceph-mgr-modules-core-18.1.3-11.g0484 1.2 MB/s | 240 kB 00:00 2023-07-29T16:35:32.789 INFO:teuthology.orchestra.run.smithi070.stdout:(116/122): openblas-threads-0.3.15-3.el8.x86_64 25 MB/s | 4.9 MB 00:00 2023-07-29T16:35:32.836 INFO:teuthology.orchestra.run.smithi102.stdout:(31/122): ceph-mgr-rook-18.1.3-11.g0484097b.el8 816 kB/s | 47 kB 00:00 2023-07-29T16:35:32.869 INFO:teuthology.orchestra.run.smithi070.stdout:(117/122): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-07-29T16:35:32.895 INFO:teuthology.orchestra.run.smithi070.stdout:(118/122): jq-1.6-3.el8.x86_64.rpm 1.9 MB/s | 202 kB 00:00 2023-07-29T16:35:32.895 INFO:teuthology.orchestra.run.smithi102.stdout:(32/122): ceph-prometheus-alerts-18.1.3-11.g048 249 kB/s | 15 kB 00:00 2023-07-29T16:35:32.920 INFO:teuthology.orchestra.run.smithi070.stdout:(119/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-29T16:35:33.112 INFO:teuthology.orchestra.run.smithi102.stdout:(33/122): ceph-volume-18.1.3-11.g0484097b.el8.n 1.2 MB/s | 258 kB 00:00 2023-07-29T16:35:33.262 INFO:teuthology.orchestra.run.smithi102.stdout:(34/122): cephadm-18.1.3-11.g0484097b.el8.noarc 1.0 MB/s | 160 kB 00:00 2023-07-29T16:35:33.669 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-07-29T16:35:33.673 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-07-29T16:35:33.887 INFO:teuthology.orchestra.run.smithi070.stdout:(120/122): librados2-18.1.3-11.g0484097b.el8.x8 3.7 MB/s | 3.7 MB 00:00 2023-07-29T16:35:34.170 INFO:teuthology.orchestra.run.smithi070.stdout:(121/122): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.8 MB/s | 3.6 MB 00:01 2023-07-29T16:35:34.171 INFO:teuthology.orchestra.run.smithi102.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 337 kB/s | 306 kB 00:00 2023-07-29T16:35:34.304 INFO:teuthology.orchestra.run.smithi102.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2023-07-29T16:35:34.471 INFO:teuthology.orchestra.run.smithi102.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 451 kB/s | 75 kB 00:00 2023-07-29T16:35:34.897 INFO:teuthology.orchestra.run.smithi102.stdout:(38/122): ceph-mgr-diskprediction-local-18.1.3- 2.0 MB/s | 7.4 MB 00:03 2023-07-29T16:35:35.030 INFO:teuthology.orchestra.run.smithi102.stdout:(39/122): python3-asyncssh-2.7.0-2.el8.noarch.r 851 kB/s | 476 kB 00:00 2023-07-29T16:35:35.120 INFO:teuthology.orchestra.run.smithi070.stdout:(122/122): ceph-test-18.1.3-11.g0484097b.el8.x8 3.6 MB/s | 47 MB 00:13 2023-07-29T16:35:35.123 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:35:35.124 INFO:teuthology.orchestra.run.smithi070.stdout:Total 8.4 MB/s | 194 MB 00:23 2023-07-29T16:35:35.214 INFO:teuthology.orchestra.run.smithi102.stdout:(40/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 138 kB/s | 44 kB 00:00 2023-07-29T16:35:35.239 INFO:teuthology.orchestra.run.smithi102.stdout:(41/122): python3-beautifulsoup4-4.6.3-2.el8.1. 888 kB/s | 185 kB 00:00 2023-07-29T16:35:35.306 INFO:teuthology.orchestra.run.smithi102.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-07-29T16:35:35.331 INFO:teuthology.orchestra.run.smithi102.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-07-29T16:35:35.473 INFO:teuthology.orchestra.run.smithi102.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2023-07-29T16:35:35.573 INFO:teuthology.orchestra.run.smithi102.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 814 kB/s | 81 kB 00:00 2023-07-29T16:35:35.641 INFO:teuthology.orchestra.run.smithi102.stdout:(46/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-07-29T16:35:35.666 INFO:teuthology.orchestra.run.smithi102.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-07-29T16:35:35.733 INFO:teuthology.orchestra.run.smithi102.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-07-29T16:35:35.825 INFO:teuthology.orchestra.run.smithi102.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-07-29T16:35:35.859 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2023-07-29T16:35:35.917 INFO:teuthology.orchestra.run.smithi102.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2023-07-29T16:35:35.970 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2023-07-29T16:35:35.970 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2023-07-29T16:35:36.009 INFO:teuthology.orchestra.run.smithi102.stdout:(51/122): python3-natsort-7.1.1-2.el8.noarch.rp 658 kB/s | 60 kB 00:00 2023-07-29T16:35:36.044 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-07-29T16:35:36.109 INFO:teuthology.orchestra.run.smithi102.stdout:(52/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-07-29T16:35:36.201 INFO:teuthology.orchestra.run.smithi102.stdout:(53/122): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-07-29T16:35:36.229 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-07-29T16:35:36.293 INFO:teuthology.orchestra.run.smithi102.stdout:(54/122): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2023-07-29T16:35:36.377 INFO:teuthology.orchestra.run.smithi102.stdout:(55/122): python3-kubernetes-11.0.0-6.el8.noarc 1.6 MB/s | 1.2 MB 00:00 2023-07-29T16:35:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-07-29T16:35:36.402 INFO:teuthology.orchestra.run.smithi102.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-07-29T16:35:36.462 INFO:teuthology.orchestra.run.smithi102.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 767 kB/s | 64 kB 00:00 2023-07-29T16:35:36.486 INFO:teuthology.orchestra.run.smithi102.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2023-07-29T16:35:36.545 INFO:teuthology.orchestra.run.smithi102.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2023-07-29T16:35:36.570 INFO:teuthology.orchestra.run.smithi102.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-07-29T16:35:36.596 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-07-29T16:35:36.628 INFO:teuthology.orchestra.run.smithi102.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 330 kB/s | 27 kB 00:00 2023-07-29T16:35:36.670 INFO:teuthology.orchestra.run.smithi102.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-07-29T16:35:36.770 INFO:teuthology.orchestra.run.smithi102.stdout:(63/122): python3-websocket-client-0.56.0-5.el8 613 kB/s | 61 kB 00:00 2023-07-29T16:35:36.788 INFO:teuthology.orchestra.run.smithi102.stdout:(64/122): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-07-29T16:35:36.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-07-29T16:35:36.863 INFO:teuthology.orchestra.run.smithi102.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 928 kB/s | 85 kB 00:00 2023-07-29T16:35:36.889 INFO:teuthology.orchestra.run.smithi102.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-07-29T16:35:36.914 INFO:teuthology.orchestra.run.smithi102.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-29T16:35:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-07-29T16:35:36.998 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2023-07-29T16:35:37.002 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2023-07-29T16:35:37.130 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-07-29T16:35:37.206 INFO:teuthology.orchestra.run.smithi102.stdout:(68/122): python3-scipy-1.0.0-21.module+el8.5.0 47 MB/s | 14 MB 00:00 2023-07-29T16:35:37.239 INFO:teuthology.orchestra.run.smithi102.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 4.6 MB/s | 1.7 MB 00:00 2023-07-29T16:35:37.265 INFO:teuthology.orchestra.run.smithi102.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-07-29T16:35:37.306 INFO:teuthology.orchestra.run.smithi102.stdout:(71/122): python3-pytz-2017.2-9.el8.noarch.rpm 808 kB/s | 54 kB 00:00 2023-07-29T16:35:37.355 INFO:teuthology.orchestra.run.smithi102.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-07-29T16:35:37.390 INFO:teuthology.orchestra.run.smithi102.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-07-29T16:35:37.416 INFO:teuthology.orchestra.run.smithi102.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 638 kB/s | 39 kB 00:00 2023-07-29T16:35:37.449 INFO:teuthology.orchestra.run.smithi102.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-07-29T16:35:37.483 INFO:teuthology.orchestra.run.smithi102.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-07-29T16:35:37.508 INFO:teuthology.orchestra.run.smithi102.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-29T16:35:37.521 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-07-29T16:35:37.533 INFO:teuthology.orchestra.run.smithi102.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-07-29T16:35:37.567 INFO:teuthology.orchestra.run.smithi102.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-29T16:35:37.601 INFO:teuthology.orchestra.run.smithi102.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 797 kB/s | 27 kB 00:00 2023-07-29T16:35:37.643 INFO:teuthology.orchestra.run.smithi102.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-29T16:35:37.676 INFO:teuthology.orchestra.run.smithi102.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-07-29T16:35:37.730 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:37.735 INFO:teuthology.orchestra.run.smithi102.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-07-29T16:35:37.777 INFO:teuthology.orchestra.run.smithi102.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-07-29T16:35:37.819 INFO:teuthology.orchestra.run.smithi102.stdout:(85/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-29T16:35:37.928 INFO:teuthology.orchestra.run.smithi102.stdout:(86/122): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-07-29T16:35:37.953 INFO:teuthology.orchestra.run.smithi102.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 945 kB/s | 126 kB 00:00 2023-07-29T16:35:37.995 INFO:teuthology.orchestra.run.smithi102.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 300 kB/s | 20 kB 00:00 2023-07-29T16:35:38.020 INFO:teuthology.orchestra.run.smithi102.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-07-29T16:35:38.054 INFO:teuthology.orchestra.run.smithi102.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-07-29T16:35:38.124 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:38.188 INFO:teuthology.orchestra.run.smithi102.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2023-07-29T16:35:38.263 INFO:teuthology.orchestra.run.smithi102.stdout:(92/122): openblas-0.3.15-3.el8.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-07-29T16:35:38.288 INFO:teuthology.orchestra.run.smithi102.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-07-29T16:35:38.297 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:38.313 INFO:teuthology.orchestra.run.smithi102.stdout:(94/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.8 MB/s | 354 kB 00:00 2023-07-29T16:35:38.339 INFO:teuthology.orchestra.run.smithi102.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 931 kB/s | 47 kB 00:00 2023-07-29T16:35:38.364 INFO:teuthology.orchestra.run.smithi102.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-07-29T16:35:38.389 INFO:teuthology.orchestra.run.smithi102.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-07-29T16:35:38.415 INFO:teuthology.orchestra.run.smithi102.stdout:(98/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-29T16:35:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:38.440 INFO:teuthology.orchestra.run.smithi102.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 955 kB/s | 48 kB 00:00 2023-07-29T16:35:38.465 INFO:teuthology.orchestra.run.smithi102.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-29T16:35:38.491 INFO:teuthology.orchestra.run.smithi102.stdout:(101/122): python3-requests-oauthlib-1.0.0-1.el 852 kB/s | 43 kB 00:00 2023-07-29T16:35:38.507 INFO:teuthology.orchestra.run.smithi102.stdout:(102/122): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-07-29T16:35:38.524 INFO:teuthology.orchestra.run.smithi102.stdout:(103/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.6 MB/s | 229 kB 00:00 2023-07-29T16:35:38.558 INFO:teuthology.orchestra.run.smithi102.stdout:(104/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-07-29T16:35:38.583 INFO:teuthology.orchestra.run.smithi102.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-07-29T16:35:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-07-29T16:35:38.630 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:38.631 INFO:teuthology.orchestra.run.smithi102.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 2.1 MB/s | 155 kB 00:00 2023-07-29T16:35:38.667 INFO:teuthology.orchestra.run.smithi102.stdout:(107/122): python3-cryptography-3.2.1-5.el8.x86 6.5 MB/s | 559 kB 00:00 2023-07-29T16:35:38.693 INFO:teuthology.orchestra.run.smithi102.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 293 kB/s | 18 kB 00:00 2023-07-29T16:35:38.726 INFO:teuthology.orchestra.run.smithi102.stdout:(109/122): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-07-29T16:35:38.729 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:38.752 INFO:teuthology.orchestra.run.smithi102.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-07-29T16:35:38.785 INFO:teuthology.orchestra.run.smithi102.stdout:(111/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-07-29T16:35:38.824 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-07-29T16:35:38.844 INFO:teuthology.orchestra.run.smithi102.stdout:(112/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 20 MB/s | 2.3 MB 00:00 2023-07-29T16:35:38.869 INFO:teuthology.orchestra.run.smithi102.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 992 kB/s | 83 kB 00:00 2023-07-29T16:35:38.894 INFO:teuthology.orchestra.run.smithi102.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-07-29T16:35:38.920 INFO:teuthology.orchestra.run.smithi102.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-07-29T16:35:38.945 INFO:teuthology.orchestra.run.smithi102.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-29T16:35:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:35:38.970 INFO:teuthology.orchestra.run.smithi102.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-07-29T16:35:39.004 INFO:teuthology.orchestra.run.smithi102.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-07-29T16:35:39.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-07-29T16:35:39.029 INFO:teuthology.orchestra.run.smithi102.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.8 MB/s | 171 kB 00:00 2023-07-29T16:35:39.209 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-07-29T16:35:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-07-29T16:35:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-07-29T16:35:39.551 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-07-29T16:35:39.568 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-07-29T16:35:39.739 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:39.833 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:39.958 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-07-29T16:35:40.005 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/124 2023-07-29T16:35:40.255 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-07-29T16:35:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-07-29T16:35:40.446 INFO:teuthology.orchestra.run.smithi102.stdout:(120/122): ceph-test-18.1.3-11.g0484097b.el8.x8 3.3 MB/s | 47 MB 00:13 2023-07-29T16:35:40.513 INFO:teuthology.orchestra.run.smithi102.stdout:(121/122): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.4 MB/s | 3.6 MB 00:01 2023-07-29T16:35:40.546 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-07-29T16:35:40.681 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/124 2023-07-29T16:35:40.925 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:41.074 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-07-29T16:35:41.201 INFO:teuthology.orchestra.run.smithi102.stdout:(122/122): librados2-18.1.3-11.g0484097b.el8.x8 1.7 MB/s | 3.7 MB 00:02 2023-07-29T16:35:41.204 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2023-07-29T16:35:41.204 INFO:teuthology.orchestra.run.smithi102.stdout:Total 7.7 MB/s | 194 MB 00:25 2023-07-29T16:35:41.296 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-07-29T16:35:41.309 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:41.597 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:41.822 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-07-29T16:35:41.896 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-07-29T16:35:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2023-07-29T16:35:41.928 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2023-07-29T16:35:42.015 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2023-07-29T16:35:42.015 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2023-07-29T16:35:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-07-29T16:35:42.079 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-07-29T16:35:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-07-29T16:35:42.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-07-29T16:35:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-07-29T16:35:42.451 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:42.465 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-07-29T16:35:42.541 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-07-29T16:35:42.734 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:42.786 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-07-29T16:35:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-07-29T16:35:42.884 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:43.064 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-07-29T16:35:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-07-29T16:35:43.147 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2023-07-29T16:35:43.163 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2023-07-29T16:35:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-07-29T16:35:43.289 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-07-29T16:35:43.298 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-07-29T16:35:43.422 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/124 2023-07-29T16:35:43.457 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-07-29T16:35:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-07-29T16:35:43.625 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-07-29T16:35:43.710 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-07-29T16:35:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-07-29T16:35:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/124 2023-07-29T16:35:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-07-29T16:35:43.958 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-07-29T16:35:44.047 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-07-29T16:35:44.160 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:44.319 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 24/124 2023-07-29T16:35:44.331 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:44.473 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 25/124 2023-07-29T16:35:44.582 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-07-29T16:35:44.585 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:44.792 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-07-29T16:35:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-07-29T16:35:45.016 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-07-29T16:35:45.192 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-07-29T16:35:45.372 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:45.386 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:35:45.398 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-07-29T16:35:45.477 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:45.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-07-29T16:35:45.758 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-07-29T16:35:45.813 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-07-29T16:35:45.962 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-07-29T16:35:46.188 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-07-29T16:35:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-07-29T16:35:46.371 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-07-29T16:35:46.458 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-07-29T16:35:46.514 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-07-29T16:35:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-07-29T16:35:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-07-29T16:35:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-07-29T16:35:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-07-29T16:35:46.939 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-07-29T16:35:47.185 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-07-29T16:35:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 24/124 2023-07-29T16:35:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 25/124 2023-07-29T16:35:47.551 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-07-29T16:35:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-07-29T16:35:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:35:47.769 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2023-07-29T16:35:47.936 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-07-29T16:35:47.983 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-07-29T16:35:48.096 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-07-29T16:35:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-07-29T16:35:48.310 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-07-29T16:35:48.353 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-07-29T16:35:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-07-29T16:35:48.521 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-07-29T16:35:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-07-29T16:35:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-07-29T16:35:48.753 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-07-29T16:35:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-07-29T16:35:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 34/124 2023-07-29T16:35:49.121 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-07-29T16:35:49.238 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-07-29T16:35:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 35/124 2023-07-29T16:35:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-07-29T16:35:49.509 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-07-29T16:35:49.531 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-07-29T16:35:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-07-29T16:35:49.717 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-07-29T16:35:49.721 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-07-29T16:35:49.806 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-07-29T16:35:49.931 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-07-29T16:35:49.963 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-07-29T16:35:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:35:50.119 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 24/124 2023-07-29T16:35:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-07-29T16:35:50.269 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 25/124 2023-07-29T16:35:50.321 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:50.356 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-07-29T16:35:50.430 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:35:50.467 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:35:50.605 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-07-29T16:35:50.686 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:35:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-07-29T16:35:50.773 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-07-29T16:35:50.924 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:35:51.007 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-07-29T16:35:51.104 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-07-29T16:35:51.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-07-29T16:35:51.214 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-07-29T16:35:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-07-29T16:35:51.384 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-07-29T16:35:51.423 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-07-29T16:35:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:51.630 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:35:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-07-29T16:35:51.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-07-29T16:35:51.804 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:51.877 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-07-29T16:35:51.887 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 13/124 2023-07-29T16:35:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-07-29T16:35:52.021 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-07-29T16:35:52.059 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-07-29T16:35:52.188 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-07-29T16:35:52.236 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-07-29T16:35:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 34/124 2023-07-29T16:35:52.321 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-07-29T16:35:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-07-29T16:35:52.450 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-07-29T16:35:52.489 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 35/124 2023-07-29T16:35:52.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-07-29T16:35:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-07-29T16:35:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-07-29T16:35:52.820 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-07-29T16:35:52.935 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-07-29T16:35:53.022 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-07-29T16:35:53.051 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-07-29T16:35:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-07-29T16:35:53.279 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-07-29T16:35:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-07-29T16:35:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-07-29T16:35:53.441 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-07-29T16:35:53.521 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-07-29T16:35:53.567 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-07-29T16:35:53.676 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-07-29T16:35:53.725 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-07-29T16:35:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-07-29T16:35:53.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-07-29T16:35:53.870 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-07-29T16:35:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-07-29T16:35:53.996 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-07-29T16:35:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-07-29T16:35:54.199 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-07-29T16:35:54.224 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-07-29T16:35:54.235 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-07-29T16:35:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-07-29T16:35:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-07-29T16:35:54.424 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-07-29T16:35:54.556 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-07-29T16:35:54.597 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-07-29T16:35:54.623 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-07-29T16:35:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-07-29T16:35:54.801 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-07-29T16:35:54.817 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 34/124 2023-07-29T16:35:54.831 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-07-29T16:35:54.837 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-07-29T16:35:54.985 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 35/124 2023-07-29T16:35:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-07-29T16:35:55.038 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-07-29T16:35:55.055 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-07-29T16:35:55.055 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-07-29T16:35:55.144 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-07-29T16:35:55.232 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-07-29T16:35:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-07-29T16:35:55.273 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-07-29T16:35:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-07-29T16:35:55.428 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-07-29T16:35:55.451 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-07-29T16:35:55.483 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-07-29T16:35:55.577 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-07-29T16:35:55.633 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-07-29T16:35:55.668 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-07-29T16:35:55.706 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-07-29T16:35:55.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-07-29T16:35:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-07-29T16:35:55.880 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-07-29T16:35:55.954 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-07-29T16:35:55.958 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-07-29T16:35:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 24/124 2023-07-29T16:35:56.070 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-07-29T16:35:56.175 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-07-29T16:35:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 25/124 2023-07-29T16:35:56.209 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-07-29T16:35:56.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-07-29T16:35:56.348 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-07-29T16:35:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-07-29T16:35:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-07-29T16:35:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-07-29T16:35:56.621 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-07-29T16:35:56.694 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-07-29T16:35:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-07-29T16:35:56.810 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-07-29T16:35:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-07-29T16:35:57.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-07-29T16:35:57.029 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-07-29T16:35:57.056 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:35:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-07-29T16:35:57.219 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-07-29T16:35:57.257 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-07-29T16:35:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-07-29T16:35:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-07-29T16:35:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-07-29T16:35:57.458 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-07-29T16:35:57.524 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-07-29T16:35:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-07-29T16:35:57.655 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-07-29T16:35:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-07-29T16:35:57.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-07-29T16:35:57.856 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-07-29T16:35:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-07-29T16:35:57.903 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-07-29T16:35:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-07-29T16:35:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-07-29T16:35:58.103 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-07-29T16:35:58.157 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-07-29T16:35:58.179 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-07-29T16:35:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-07-29T16:35:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-07-29T16:35:58.397 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-07-29T16:35:58.623 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-07-29T16:35:58.636 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-07-29T16:35:58.642 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-07-29T16:35:58.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-07-29T16:35:58.898 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-07-29T16:35:58.903 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-07-29T16:35:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-07-29T16:35:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-07-29T16:35:59.176 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-07-29T16:35:59.281 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-07-29T16:35:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-07-29T16:35:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-07-29T16:35:59.604 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-07-29T16:35:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-07-29T16:35:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-07-29T16:35:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-07-29T16:35:59.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-07-29T16:36:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-07-29T16:36:00.085 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-07-29T16:36:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-07-29T16:36:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-07-29T16:36:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-07-29T16:36:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-07-29T16:36:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-07-29T16:36:00.448 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-07-29T16:36:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-07-29T16:36:00.573 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-07-29T16:36:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-07-29T16:36:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-07-29T16:36:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-07-29T16:36:00.818 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-07-29T16:36:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-07-29T16:36:00.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 34/124 2023-07-29T16:36:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-07-29T16:36:00.990 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-07-29T16:36:01.001 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 35/124 2023-07-29T16:36:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-07-29T16:36:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-07-29T16:36:01.198 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-07-29T16:36:01.211 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-07-29T16:36:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-07-29T16:36:01.364 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-07-29T16:36:01.388 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-07-29T16:36:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-07-29T16:36:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-07-29T16:36:01.564 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-07-29T16:36:01.567 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-07-29T16:36:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-07-29T16:36:01.720 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-07-29T16:36:01.765 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-07-29T16:36:01.793 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-07-29T16:36:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-07-29T16:36:01.991 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-07-29T16:36:02.038 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-07-29T16:36:02.122 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-07-29T16:36:02.184 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-07-29T16:36:02.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-07-29T16:36:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-07-29T16:36:02.354 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-07-29T16:36:02.463 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-07-29T16:36:02.476 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-07-29T16:36:02.501 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:02.556 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:02.593 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-07-29T16:36:02.662 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-07-29T16:36:02.704 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-07-29T16:36:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 90/124 2023-07-29T16:36:02.861 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-07-29T16:36:02.889 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-07-29T16:36:02.979 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-07-29T16:36:03.121 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-07-29T16:36:03.124 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-07-29T16:36:03.332 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-07-29T16:36:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-07-29T16:36:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-07-29T16:36:03.581 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-07-29T16:36:03.724 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-07-29T16:36:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-07-29T16:36:03.871 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-07-29T16:36:03.980 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-07-29T16:36:04.001 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-07-29T16:36:04.119 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-07-29T16:36:04.192 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-07-29T16:36:04.281 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-07-29T16:36:04.327 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-07-29T16:36:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-07-29T16:36:04.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-07-29T16:36:04.558 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-07-29T16:36:04.582 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-07-29T16:36:04.716 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-07-29T16:36:04.906 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-07-29T16:36:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-07-29T16:36:05.122 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-07-29T16:36:05.208 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-07-29T16:36:05.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-07-29T16:36:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-07-29T16:36:05.699 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-07-29T16:36:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-07-29T16:36:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-07-29T16:36:05.926 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-07-29T16:36:06.055 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-07-29T16:36:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-07-29T16:36:06.268 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-07-29T16:36:06.348 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 90/124 2023-07-29T16:36:06.386 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-07-29T16:36:06.489 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-07-29T16:36:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-07-29T16:36:06.761 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-07-29T16:36:06.878 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-07-29T16:36:06.938 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-07-29T16:36:06.968 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-07-29T16:36:07.140 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-07-29T16:36:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:07.311 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-07-29T16:36:07.498 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:07.510 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-07-29T16:36:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:07.673 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-07-29T16:36:07.717 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:07.761 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-07-29T16:36:07.917 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-07-29T16:36:07.995 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 90/124 2023-07-29T16:36:08.193 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-07-29T16:36:08.349 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-07-29T16:36:08.497 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-07-29T16:36:08.704 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-07-29T16:36:08.915 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-07-29T16:36:09.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-07-29T16:36:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-07-29T16:36:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-07-29T16:36:09.630 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-07-29T16:36:09.856 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-07-29T16:36:10.002 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:10.074 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-07-29T16:36:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:10.331 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-07-29T16:36:10.526 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-07-29T16:36:10.734 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-07-29T16:36:10.833 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:10.936 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-07-29T16:36:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:11.750 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:11.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:12.032 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-07-29T16:36:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-07-29T16:36:12.531 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:12.534 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-07-29T16:36:12.815 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:12.852 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-07-29T16:36:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:13.141 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-07-29T16:36:13.360 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-07-29T16:36:14.162 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-07-29T16:36:14.384 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:14.460 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 89/124 2023-07-29T16:36:14.660 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 90/124 2023-07-29T16:36:18.256 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:18.493 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 91/124 2023-07-29T16:36:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:20.205 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 92/124 2023-07-29T16:36:20.384 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:26.677 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:26.677 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-07-29T16:36:26.678 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-07-29T16:36:26.679 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-07-29T16:36:26.679 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:36:27.023 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:28.601 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:29.012 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:29.200 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:29.656 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:29.881 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:29.898 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:30.795 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2023-07-29T16:36:30.795 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /run 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2023-07-29T16:36:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2023-07-29T16:36:30.797 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-07-29T16:36:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:36:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:31.714 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:31.714 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2023-07-29T16:36:31.715 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2023-07-29T16:36:31.715 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-07-29T16:36:31.715 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /run 2023-07-29T16:36:31.715 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2023-07-29T16:36:31.715 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2023-07-29T16:36:31.716 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2023-07-29T16:36:31.716 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2023-07-29T16:36:31.716 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-07-29T16:36:31.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:36:31.881 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:32.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 99/124 2023-07-29T16:36:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:32.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 100/124 2023-07-29T16:36:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:32.636 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:32.703 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:32.928 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:33.084 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:33.261 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:33.681 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:33.860 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:33.890 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:33.936 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:33.953 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:34.055 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:34.145 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:34.211 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 104/124 2023-07-29T16:36:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:34.694 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:34.729 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:35.916 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 99/124 2023-07-29T16:36:36.082 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 100/124 2023-07-29T16:36:36.190 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 107/124 2023-07-29T16:36:36.277 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:36.491 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:36.557 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:36.563 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:36.729 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:36.849 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:36.850 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 99/124 2023-07-29T16:36:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:37.057 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 100/124 2023-07-29T16:36:37.071 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:37.807 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 104/124 2023-07-29T16:36:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:38.683 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:38.718 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:38.844 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:38.901 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:38.913 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:38.934 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 93/124 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /dev 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /run 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2023-07-29T16:36:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2023-07-29T16:36:39.046 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2023-07-29T16:36:39.046 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2023-07-29T16:36:39.046 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /dev 2023-07-29T16:36:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:36:39.271 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 104/124 2023-07-29T16:36:39.390 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:39.442 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:40.151 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 107/124 2023-07-29T16:36:40.383 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:40.569 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:40.903 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 107/124 2023-07-29T16:36:40.912 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 94/124 2023-07-29T16:36:41.076 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:41.187 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:41.361 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 95/124 2023-07-29T16:36:41.385 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:41.512 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:41.515 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 111/124 2023-07-29T16:36:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:41.994 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 96/124 2023-07-29T16:36:41.995 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-07-29T16:36:42.181 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:42.198 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 97/124 2023-07-29T16:36:42.662 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-07-29T16:36:42.969 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-07-29T16:36:43.174 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 114/124 2023-07-29T16:36:43.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-07-29T16:36:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 116/124 2023-07-29T16:36:43.704 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-07-29T16:36:43.860 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:43.887 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 118/124 2023-07-29T16:36:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 119/124 2023-07-29T16:36:44.046 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 98/124 2023-07-29T16:36:44.154 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 99/124 2023-07-29T16:36:44.232 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-07-29T16:36:44.328 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 100/124 2023-07-29T16:36:44.403 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-07-29T16:36:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-07-29T16:36:44.514 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:44.662 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-07-29T16:36:44.675 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-07-29T16:36:44.675 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:44.727 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 101/124 2023-07-29T16:36:44.907 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:44.907 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:45.043 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:45.508 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:45.605 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:45.605 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/124 2023-07-29T16:36:45.605 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:36:45.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:36:45.607 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/124 2023-07-29T16:36:45.607 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/124 2023-07-29T16:36:45.607 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:36:45.607 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/124 2023-07-29T16:36:45.607 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/124 2023-07-29T16:36:45.608 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:36:45.609 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/124 2023-07-29T16:36:45.616 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/124 2023-07-29T16:36:45.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/124 2023-07-29T16:36:45.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/124 2023-07-29T16:36:45.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/124 2023-07-29T16:36:45.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/124 2023-07-29T16:36:45.617 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-07-29T16:36:45.618 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-07-29T16:36:45.619 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-07-29T16:36:45.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-07-29T16:36:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-07-29T16:36:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-07-29T16:36:45.623 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-07-29T16:36:45.624 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-07-29T16:36:45.625 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-07-29T16:36:45.626 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-07-29T16:36:45.627 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-07-29T16:36:45.628 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 121/124 2023-07-29T16:36:45.629 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-07-29T16:36:45.630 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 123/124 2023-07-29T16:36:46.002 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 102/124 2023-07-29T16:36:46.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:46.263 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 103/124 2023-07-29T16:36:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:46.440 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 111/124 2023-07-29T16:36:46.655 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 104/124 2023-07-29T16:36:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-07-29T16:36:46.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:46.870 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 105/124 2023-07-29T16:36:46.989 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 113/124 2023-07-29T16:36:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 106/124 2023-07-29T16:36:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 111/124 2023-07-29T16:36:47.221 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-07-29T16:36:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-07-29T16:36:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-07-29T16:36:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-07-29T16:36:47.621 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 116/124 2023-07-29T16:36:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 113/124 2023-07-29T16:36:47.775 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-07-29T16:36:47.914 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-07-29T16:36:47.967 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 118/124 2023-07-29T16:36:48.100 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-07-29T16:36:48.111 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-07-29T16:36:48.194 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 119/124 2023-07-29T16:36:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:48.269 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:49 ago on Sat 29 Jul 2023 04:34:59 PM UTC. 2023-07-29T16:36:48.270 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 116/124 2023-07-29T16:36:48.328 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 107/124 2023-07-29T16:36:48.342 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-07-29T16:36:48.430 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-07-29T16:36:48.450 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-07-29T16:36:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:48.592 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-07-29T16:36:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 108/124 2023-07-29T16:36:48.604 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-07-29T16:36:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 118/124 2023-07-29T16:36:48.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:48.752 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-07-29T16:36:48.753 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:48.812 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 119/124 2023-07-29T16:36:48.928 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:49.016 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-07-29T16:36:49.084 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 109/124 2023-07-29T16:36:49.100 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-07-29T16:36:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:49.274 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-07-29T16:36:49.287 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-07-29T16:36:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-07-29T16:36:49.435 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/124 2023-07-29T16:36:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/124 2023-07-29T16:36:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:36:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:36:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:36:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:36:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/124 2023-07-29T16:36:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/124 2023-07-29T16:36:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:36:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/124 2023-07-29T16:36:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/124 2023-07-29T16:36:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/124 2023-07-29T16:36:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/124 2023-07-29T16:36:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/124 2023-07-29T16:36:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/124 2023-07-29T16:36:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/124 2023-07-29T16:36:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/124 2023-07-29T16:36:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/124 2023-07-29T16:36:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/124 2023-07-29T16:36:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/124 2023-07-29T16:36:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/124 2023-07-29T16:36:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/124 2023-07-29T16:36:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:36:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/124 2023-07-29T16:36:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/124 2023-07-29T16:36:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/124 2023-07-29T16:36:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/124 2023-07-29T16:36:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/124 2023-07-29T16:36:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/124 2023-07-29T16:36:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/124 2023-07-29T16:36:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/124 2023-07-29T16:36:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/124 2023-07-29T16:36:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/124 2023-07-29T16:36:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-07-29T16:36:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-07-29T16:36:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-07-29T16:36:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-07-29T16:36:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-07-29T16:36:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-07-29T16:36:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-07-29T16:36:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-07-29T16:36:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-07-29T16:36:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-07-29T16:36:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-07-29T16:36:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-07-29T16:36:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-07-29T16:36:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-07-29T16:36:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-07-29T16:36:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-07-29T16:36:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-07-29T16:36:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-07-29T16:36:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-07-29T16:36:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-07-29T16:36:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-07-29T16:36:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-07-29T16:36:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-07-29T16:36:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-07-29T16:36:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-07-29T16:36:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-07-29T16:36:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-07-29T16:36:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-07-29T16:36:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-07-29T16:36:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-07-29T16:36:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-07-29T16:36:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-07-29T16:36:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-07-29T16:36:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-07-29T16:36:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 121/124 2023-07-29T16:36:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-07-29T16:36:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 123/124 2023-07-29T16:36:50.341 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/124 2023-07-29T16:36:50.342 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:36:50.343 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/124 2023-07-29T16:36:50.344 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/124 2023-07-29T16:36:50.345 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/124 2023-07-29T16:36:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:36:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/124 2023-07-29T16:36:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/124 2023-07-29T16:36:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/124 2023-07-29T16:36:50.346 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/124 2023-07-29T16:36:50.347 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/124 2023-07-29T16:36:50.347 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/124 2023-07-29T16:36:50.347 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/124 2023-07-29T16:36:50.347 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-07-29T16:36:50.348 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-07-29T16:36:50.349 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-07-29T16:36:50.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-07-29T16:36:50.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-07-29T16:36:50.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-07-29T16:36:50.350 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-07-29T16:36:50.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-07-29T16:36:50.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-07-29T16:36:50.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-07-29T16:36:50.351 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-07-29T16:36:50.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-07-29T16:36:50.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-07-29T16:36:50.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-07-29T16:36:50.352 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-07-29T16:36:50.353 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-07-29T16:36:50.353 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-07-29T16:36:50.353 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-07-29T16:36:50.354 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-07-29T16:36:50.354 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-07-29T16:36:50.354 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-07-29T16:36:50.354 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-07-29T16:36:50.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-07-29T16:36:50.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-07-29T16:36:50.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-07-29T16:36:50.355 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-07-29T16:36:50.356 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-07-29T16:36:50.356 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-07-29T16:36:50.356 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-07-29T16:36:50.356 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-07-29T16:36:50.357 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-07-29T16:36:50.357 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-07-29T16:36:50.357 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-07-29T16:36:50.357 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-07-29T16:36:50.358 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-07-29T16:36:50.358 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-07-29T16:36:50.358 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-07-29T16:36:50.358 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-07-29T16:36:50.359 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-07-29T16:36:50.359 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-07-29T16:36:50.359 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-07-29T16:36:50.359 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-07-29T16:36:50.359 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-07-29T16:36:50.360 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-07-29T16:36:50.360 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-07-29T16:36:50.360 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-07-29T16:36:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-07-29T16:36:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-07-29T16:36:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-07-29T16:36:50.361 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-07-29T16:36:50.362 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-07-29T16:36:50.362 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-07-29T16:36:50.362 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-07-29T16:36:50.362 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-07-29T16:36:50.363 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-07-29T16:36:50.363 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-07-29T16:36:50.363 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-07-29T16:36:50.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-07-29T16:36:50.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-07-29T16:36:50.364 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-07-29T16:36:50.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-07-29T16:36:50.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-07-29T16:36:50.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-07-29T16:36:50.365 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-07-29T16:36:50.366 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-07-29T16:36:50.366 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-07-29T16:36:50.366 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-07-29T16:36:50.366 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-07-29T16:36:50.367 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-07-29T16:36:50.367 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-07-29T16:36:50.367 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-07-29T16:36:50.367 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-07-29T16:36:50.367 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 121/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-07-29T16:36:50.368 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 123/124 2023-07-29T16:36:50.681 INFO:teuthology.orchestra.run.smithi151.stdout:Installed products updated. 2023-07-29T16:36:50.908 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:36:50.909 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-07-29T16:36:50.909 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.909 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.910 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-07-29T16:36:50.910 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T16:36:50.910 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T16:36:50.911 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.911 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.911 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.911 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.912 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.912 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.912 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.913 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.913 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.914 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.915 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.915 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.915 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.915 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.915 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T16:36:50.916 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-3.el8.x86_64 2023-07-29T16:36:50.917 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T16:36:50.917 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T16:36:50.917 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T16:36:50.917 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.918 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.918 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.918 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T16:36:50.918 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:50.919 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T16:36:50.919 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:50.919 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T16:36:50.919 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.920 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.920 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T16:36:50.920 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.920 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T16:36:50.921 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T16:36:50.921 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T16:36:50.921 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T16:36:50.921 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T16:36:50.922 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T16:36:50.922 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T16:36:50.922 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T16:36:50.922 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T16:36:50.923 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T16:36:50.923 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T16:36:50.923 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T16:36:50.923 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T16:36:50.924 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T16:36:50.924 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T16:36:50.924 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T16:36:50.925 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T16:36:50.925 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T16:36:50.925 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T16:36:50.925 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.926 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.926 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.926 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T16:36:50.926 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T16:36:50.927 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T16:36:50.927 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T16:36:50.927 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T16:36:50.927 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T16:36:50.927 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T16:36:50.928 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T16:36:50.929 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T16:36:50.929 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T16:36:50.929 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T16:36:50.929 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T16:36:50.929 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:50.930 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:50.930 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T16:36:50.930 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T16:36:50.930 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T16:36:50.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T16:36:50.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T16:36:50.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T16:36:50.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T16:36:50.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T16:36:50.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T16:36:50.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.933 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.933 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T16:36:50.933 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T16:36:50.933 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T16:36:50.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T16:36:50.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T16:36:50.934 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T16:36:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T16:36:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T16:36:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T16:36:50.935 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T16:36:50.936 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T16:36:50.936 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T16:36:50.936 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T16:36:50.936 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T16:36:50.937 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T16:36:50.937 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.937 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.937 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:50.938 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T16:36:50.938 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T16:36:50.938 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T16:36:50.938 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T16:36:50.939 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T16:36:50.939 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:36:50.940 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-29T16:36:51.093 DEBUG:teuthology.parallel:result is None 2023-07-29T16:36:52.443 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:52.444 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:53 ago on Sat 29 Jul 2023 04:34:59 PM UTC. 2023-07-29T16:36:53.016 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:53.016 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:53 ago on Sat 29 Jul 2023 04:35:00 PM UTC. 2023-07-29T16:36:53.675 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 110/124 2023-07-29T16:36:53.951 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 111/124 2023-07-29T16:36:54.163 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-07-29T16:36:54.818 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-07-29T16:36:54.934 INFO:teuthology.orchestra.run.smithi098.stdout:Installed products updated. 2023-07-29T16:36:55.135 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-07-29T16:36:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:36:55.159 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2023-07-29T16:36:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T16:36:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: jq-1.6-3.el8.x86_64 2023-07-29T16:36:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T16:36:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T16:36:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T16:36:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T16:36:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T16:36:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T16:36:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T16:36:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T16:36:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T16:36:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T16:36:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T16:36:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T16:36:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T16:36:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T16:36:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T16:36:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T16:36:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T16:36:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T16:36:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T16:36:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T16:36:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T16:36:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T16:36:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T16:36:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T16:36:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T16:36:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T16:36:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T16:36:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T16:36:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T16:36:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T16:36:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T16:36:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T16:36:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T16:36:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:36:55.182 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-07-29T16:36:55.307 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 114/124 2023-07-29T16:36:55.348 DEBUG:teuthology.parallel:result is None 2023-07-29T16:36:55.509 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-07-29T16:36:55.675 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 116/124 2023-07-29T16:36:55.734 INFO:teuthology.orchestra.run.smithi070.stdout:Installed products updated. 2023-07-29T16:36:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-07-29T16:36:55.954 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T16:36:55.955 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T16:36:55.956 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.956 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.956 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.956 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.957 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.958 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.959 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.959 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.959 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.960 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.960 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:36:55.960 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T16:36:55.960 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T16:36:55.961 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T16:36:55.961 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T16:36:55.961 INFO:teuthology.orchestra.run.smithi070.stdout: jq-1.6-3.el8.x86_64 2023-07-29T16:36:55.961 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T16:36:55.961 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T16:36:55.963 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T16:36:55.963 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.963 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.963 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.964 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T16:36:55.964 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:55.964 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T16:36:55.964 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:36:55.964 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T16:36:55.965 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.965 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.965 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T16:36:55.965 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.966 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T16:36:55.966 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T16:36:55.966 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T16:36:55.966 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T16:36:55.967 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T16:36:55.967 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T16:36:55.967 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T16:36:55.967 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T16:36:55.968 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T16:36:55.968 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T16:36:55.968 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T16:36:55.968 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T16:36:55.969 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T16:36:55.969 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T16:36:55.969 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T16:36:55.970 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T16:36:55.970 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T16:36:55.970 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T16:36:55.970 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T16:36:55.971 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.971 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.971 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.971 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T16:36:55.972 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T16:36:55.972 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T16:36:55.973 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T16:36:55.973 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T16:36:55.973 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T16:36:55.973 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T16:36:55.974 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T16:36:55.974 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T16:36:55.974 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T16:36:55.974 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T16:36:55.975 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T16:36:55.975 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T16:36:55.975 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T16:36:55.975 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T16:36:55.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T16:36:55.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T16:36:55.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T16:36:55.976 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:55.977 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T16:36:55.977 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T16:36:55.977 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T16:36:55.977 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T16:36:55.978 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T16:36:55.978 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T16:36:55.978 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T16:36:55.978 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T16:36:55.978 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T16:36:55.979 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T16:36:55.979 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.979 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.980 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T16:36:55.980 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T16:36:55.980 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.980 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T16:36:55.981 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T16:36:55.981 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T16:36:55.981 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T16:36:55.981 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T16:36:55.982 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T16:36:55.982 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T16:36:55.982 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T16:36:55.983 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T16:36:55.983 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T16:36:55.983 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T16:36:55.983 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T16:36:55.984 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T16:36:55.984 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.984 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.985 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:36:55.985 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T16:36:55.985 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T16:36:55.986 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T16:36:55.986 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T16:36:55.987 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T16:36:55.987 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:36:55.987 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-07-29T16:36:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 118/124 2023-07-29T16:36:56.174 DEBUG:teuthology.parallel:result is None 2023-07-29T16:36:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 119/124 2023-07-29T16:36:56.377 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-07-29T16:36:56.529 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-07-29T16:36:56.612 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-07-29T16:36:56.821 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-07-29T16:36:56.834 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-07-29T16:36:56.834 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:57.033 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-07-29T16:36:57.034 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:57.711 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/124 2023-07-29T16:36:57.712 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/124 2023-07-29T16:36:57.713 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/124 2023-07-29T16:36:57.713 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/124 2023-07-29T16:36:57.714 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/124 2023-07-29T16:36:57.714 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/124 2023-07-29T16:36:57.715 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/124 2023-07-29T16:36:57.715 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/124 2023-07-29T16:36:57.715 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 13/124 2023-07-29T16:36:57.715 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 14/124 2023-07-29T16:36:57.715 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 15/124 2023-07-29T16:36:57.716 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 16/124 2023-07-29T16:36:57.716 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 17/124 2023-07-29T16:36:57.716 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 18/124 2023-07-29T16:36:57.716 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 19/124 2023-07-29T16:36:57.717 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 20/124 2023-07-29T16:36:57.717 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 21/124 2023-07-29T16:36:57.717 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 22/124 2023-07-29T16:36:57.718 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 23/124 2023-07-29T16:36:57.718 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 24/124 2023-07-29T16:36:57.718 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 25/124 2023-07-29T16:36:57.718 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 26/124 2023-07-29T16:36:57.719 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 27/124 2023-07-29T16:36:57.719 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 28/124 2023-07-29T16:36:57.719 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 29/124 2023-07-29T16:36:57.720 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 30/124 2023-07-29T16:36:57.729 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 31/124 2023-07-29T16:36:57.730 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 32/124 2023-07-29T16:36:57.730 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 33/124 2023-07-29T16:36:57.730 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 34/124 2023-07-29T16:36:57.731 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 35/124 2023-07-29T16:36:57.731 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 36/124 2023-07-29T16:36:57.731 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-07-29T16:36:57.732 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-07-29T16:36:57.732 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-07-29T16:36:57.732 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-07-29T16:36:57.733 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-07-29T16:36:57.733 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-07-29T16:36:57.733 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-07-29T16:36:57.734 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-07-29T16:36:57.734 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-07-29T16:36:57.734 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-07-29T16:36:57.734 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-07-29T16:36:57.735 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-07-29T16:36:57.735 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-07-29T16:36:57.736 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-07-29T16:36:57.736 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-07-29T16:36:57.736 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-07-29T16:36:57.737 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-07-29T16:36:57.737 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-07-29T16:36:57.737 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-07-29T16:36:57.737 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-07-29T16:36:57.738 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-07-29T16:36:57.738 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-07-29T16:36:57.738 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-07-29T16:36:57.739 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-07-29T16:36:57.739 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-07-29T16:36:57.739 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-07-29T16:36:57.739 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-07-29T16:36:57.740 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-07-29T16:36:57.740 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-07-29T16:36:57.740 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-07-29T16:36:57.740 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-07-29T16:36:57.741 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-07-29T16:36:57.741 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-07-29T16:36:57.741 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-07-29T16:36:57.742 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-07-29T16:36:57.742 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-07-29T16:36:57.742 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-07-29T16:36:57.742 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-07-29T16:36:57.743 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-07-29T16:36:57.743 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-07-29T16:36:57.743 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-07-29T16:36:57.743 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-07-29T16:36:57.744 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-07-29T16:36:57.744 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-07-29T16:36:57.744 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-07-29T16:36:57.745 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-07-29T16:36:57.745 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-07-29T16:36:57.745 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-07-29T16:36:57.746 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-07-29T16:36:57.746 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-07-29T16:36:57.746 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-07-29T16:36:57.746 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-07-29T16:36:57.747 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-07-29T16:36:57.747 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-07-29T16:36:57.747 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-07-29T16:36:57.747 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-07-29T16:36:57.747 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-07-29T16:36:57.748 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-07-29T16:36:57.749 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-07-29T16:36:57.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-07-29T16:36:57.751 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-07-29T16:36:57.752 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-07-29T16:36:57.752 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-07-29T16:36:57.752 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-07-29T16:36:57.752 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-07-29T16:36:57.752 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-07-29T16:36:57.753 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-07-29T16:36:57.753 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-07-29T16:36:57.753 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 121/124 2023-07-29T16:36:57.753 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-07-29T16:36:57.753 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 123/124 2023-07-29T16:37:00.482 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-07-29T16:37:00.482 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:56 ago on Sat 29 Jul 2023 04:35:04 PM UTC. 2023-07-29T16:37:05.778 INFO:teuthology.orchestra.run.smithi102.stdout:Installed products updated. 2023-07-29T16:37:06.007 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T16:37:06.008 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.009 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.010 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T16:37:06.011 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-3.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T16:37:06.012 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T16:37:06.013 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T16:37:06.014 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T16:37:06.015 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T16:37:06.016 INFO:teuthology.orchestra.run.smithi102.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T16:37:06.017 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T16:37:06.018 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T16:37:06.019 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T16:37:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T16:37:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T16:37:06.022 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.023 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T16:37:06.024 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T16:37:06.024 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T16:37:06.024 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T16:37:06.024 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T16:37:06.025 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T16:37:06.025 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:06.025 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-07-29T16:37:06.187 DEBUG:teuthology.parallel:result is None 2023-07-29T16:37:06.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:37:06.475 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T16:37:06.504 INFO:teuthology.orchestra.run.smithi070.stdout:18.1.3-11.g0484097b.el8 2023-07-29T16:37:06.505 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T16:37:06.506 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T16:37:06.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:37:06.791 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T16:37:06.820 INFO:teuthology.orchestra.run.smithi098.stdout:18.1.3-11.g0484097b.el8 2023-07-29T16:37:06.821 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T16:37:06.821 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T16:37:06.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:37:07.106 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T16:37:07.134 INFO:teuthology.orchestra.run.smithi102.stdout:18.1.3-11.g0484097b.el8 2023-07-29T16:37:07.135 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T16:37:07.135 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T16:37:07.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T16:37:07.422 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T16:37:07.450 INFO:teuthology.orchestra.run.smithi151.stdout:18.1.3-11.g0484097b.el8 2023-07-29T16:37:07.451 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T16:37:07.451 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T16:37:07.451 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-29T16:37:07.452 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:07.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T16:37:07.500 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:07.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T16:37:07.547 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:07.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T16:37:07.595 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:07.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T16:37:07.643 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-29T16:37:07.644 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:07.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T16:37:07.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T16:37:07.748 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:07.748 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T16:37:07.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T16:37:07.851 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:07.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T16:37:07.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T16:37:07.952 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:07.953 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T16:37:07.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T16:37:08.055 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-29T16:37:08.056 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:08.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T16:37:08.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T16:37:08.157 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:08.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T16:37:08.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T16:37:08.259 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:08.260 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T16:37:08.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T16:37:08.364 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:08.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T16:37:08.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T16:37:08.467 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-29T16:37:08.467 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:08.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T16:37:08.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T16:37:08.571 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:08.572 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T16:37:08.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T16:37:08.674 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:08.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T16:37:08.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T16:37:08.776 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:08.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T16:37:08.808 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T16:37:08.879 INFO:teuthology.run_tasks:Running task ceph... 2023-07-29T16:37:08.954 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-29T16:37:08.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2023-07-29T16:37:08.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2023-07-29T16:37:08.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2023-07-29T16:37:08.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-07-29T16:37:08.995 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-29T16:37:08.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T16:37:09.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T16:37:09.034 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T16:37:09.037 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T16:37:09.067 INFO:tasks.ceph:Creating extra log directories... 2023-07-29T16:37:09.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T16:37:09.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T16:37:09.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T16:37:09.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T16:37:09.155 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-29T16:37:09.155 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-29T16:37:09.156 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'branch': 'reef-release', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': None, 'first_in_suite': False, 'job_id': '7356886', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 3661, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'targets': {'smithi070.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi098.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi151.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '61140164d2579c30ffff3970615e0f82e40c6470', 'timestamp': '2023-07-29_14:04:17', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-29T16:37:09.157 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T16:37:09.173 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T16:37:09.177 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T16:37:09.180 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T16:37:09.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T16:37:09.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T16:37:09.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T16:37:09.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T16:37:09.268 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:09.268 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T16:37:09.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T16:37:09.321 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2023-07-29T16:37:09.379 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T16:37:09.380 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:09.380 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 377489 Links: 1 2023-07-29T16:37:09.380 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:09.381 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:09.381 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-29 16:36:49.416205810 +0000 2023-07-29T16:37:09.381 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-29 16:34:08.525199717 +0000 2023-07-29T16:37:09.381 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-29 16:34:08.525199717 +0000 2023-07-29T16:37:09.381 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-07-29T16:37:09.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T16:37:09.446 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-29T16:37:09.447 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-29T16:37:09.447 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000251915 s, 2.0 MB/s 2023-07-29T16:37:09.448 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T16:37:09.507 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2023-07-29T16:37:09.565 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T16:37:09.566 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:09.566 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 378481 Links: 1 2023-07-29T16:37:09.566 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:09.567 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:09.567 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-29 16:36:49.416205810 +0000 2023-07-29T16:37:09.567 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-29 16:34:09.034192421 +0000 2023-07-29T16:37:09.568 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-29 16:34:09.034192421 +0000 2023-07-29T16:37:09.568 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-07-29T16:37:09.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T16:37:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-29T16:37:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-29T16:37:09.631 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000312389 s, 1.6 MB/s 2023-07-29T16:37:09.632 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T16:37:09.690 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2023-07-29T16:37:09.746 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T16:37:09.746 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:09.746 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 378651 Links: 1 2023-07-29T16:37:09.746 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:09.747 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:09.747 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-29 16:36:49.417205796 +0000 2023-07-29T16:37:09.747 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-29 16:34:09.560184882 +0000 2023-07-29T16:37:09.747 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-29 16:34:09.560184882 +0000 2023-07-29T16:37:09.747 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-07-29T16:37:09.747 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T16:37:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-29T16:37:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-29T16:37:09.811 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000239093 s, 2.1 MB/s 2023-07-29T16:37:09.812 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T16:37:09.870 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2023-07-29T16:37:09.926 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T16:37:09.926 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:09.926 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 382247 Links: 1 2023-07-29T16:37:09.926 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:09.926 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:09.927 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-29 16:36:49.417205796 +0000 2023-07-29T16:37:09.927 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-29 16:34:10.070177588 +0000 2023-07-29T16:37:09.927 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-29 16:34:10.070177588 +0000 2023-07-29T16:37:09.927 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2023-07-29T16:37:09.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T16:37:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-29T16:37:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-29T16:37:09.991 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000213359 s, 2.4 MB/s 2023-07-29T16:37:09.993 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T16:37:10.049 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:10.050 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:10.050 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T16:37:10.070 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T16:37:10.071 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2023-07-29T16:37:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T16:37:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:10.131 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 381961 Links: 1 2023-07-29T16:37:10.131 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:10.131 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:10.131 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-07-29 16:36:57.436734859 +0000 2023-07-29T16:37:10.132 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-07-29 16:33:55.795000164 +0000 2023-07-29T16:37:10.132 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-07-29 16:33:55.795000164 +0000 2023-07-29T16:37:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2023-07-29T16:37:10.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T16:37:10.200 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-07-29T16:37:10.200 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-07-29T16:37:10.200 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000264018 s, 1.9 MB/s 2023-07-29T16:37:10.201 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T16:37:10.263 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2023-07-29T16:37:10.323 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T16:37:10.323 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:10.323 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 381012 Links: 1 2023-07-29T16:37:10.323 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:10.323 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:10.324 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-07-29 16:36:57.436734859 +0000 2023-07-29T16:37:10.324 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-07-29 16:33:56.309989174 +0000 2023-07-29T16:37:10.324 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-07-29 16:33:56.309989174 +0000 2023-07-29T16:37:10.324 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2023-07-29T16:37:10.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T16:37:10.394 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-07-29T16:37:10.394 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-07-29T16:37:10.395 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000246395 s, 2.1 MB/s 2023-07-29T16:37:10.396 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T16:37:10.457 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2023-07-29T16:37:10.518 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T16:37:10.518 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:10.518 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 378699 Links: 1 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-07-29 16:36:57.436734859 +0000 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-07-29 16:33:56.828978097 +0000 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-07-29 16:33:56.828978097 +0000 2023-07-29T16:37:10.519 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2023-07-29T16:37:10.520 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T16:37:10.588 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-07-29T16:37:10.588 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-07-29T16:37:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000246426 s, 2.1 MB/s 2023-07-29T16:37:10.589 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T16:37:10.650 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2023-07-29T16:37:10.711 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T16:37:10.712 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:10.712 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 382152 Links: 1 2023-07-29T16:37:10.712 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:10.712 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-07-29 16:36:57.436734859 +0000 2023-07-29T16:37:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-07-29 16:33:57.382966274 +0000 2023-07-29T16:37:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-07-29 16:33:57.382966274 +0000 2023-07-29T16:37:10.713 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2023-07-29T16:37:10.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T16:37:10.782 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-07-29T16:37:10.782 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-07-29T16:37:10.782 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000194299 s, 2.6 MB/s 2023-07-29T16:37:10.783 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T16:37:10.844 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:10.845 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:10.845 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T16:37:10.866 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T16:37:10.866 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-07-29T16:37:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T16:37:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:10.925 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 373531 Links: 1 2023-07-29T16:37:10.925 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:10.925 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:10.926 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-29 16:36:45.324526539 +0000 2023-07-29T16:37:10.926 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-29 16:33:52.169113659 +0000 2023-07-29T16:37:10.926 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-29 16:33:52.169113659 +0000 2023-07-29T16:37:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-07-29T16:37:10.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T16:37:10.994 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-29T16:37:10.994 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-29T16:37:10.994 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000271907 s, 1.9 MB/s 2023-07-29T16:37:10.995 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T16:37:11.056 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-07-29T16:37:11.114 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 370467 Links: 1 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-29 16:36:45.325526526 +0000 2023-07-29T16:37:11.115 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-29 16:33:52.685106455 +0000 2023-07-29T16:37:11.116 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-29 16:33:52.685106455 +0000 2023-07-29T16:37:11.116 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-07-29T16:37:11.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T16:37:11.182 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-29T16:37:11.183 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-29T16:37:11.183 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000250852 s, 2.0 MB/s 2023-07-29T16:37:11.184 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T16:37:11.243 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-07-29T16:37:11.302 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T16:37:11.302 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 370572 Links: 1 2023-07-29T16:37:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-29 16:36:45.325526526 +0000 2023-07-29T16:37:11.304 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-29 16:33:53.196099321 +0000 2023-07-29T16:37:11.304 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-29 16:33:53.196099321 +0000 2023-07-29T16:37:11.304 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-07-29T16:37:11.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T16:37:11.367 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-29T16:37:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-29T16:37:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000204344 s, 2.5 MB/s 2023-07-29T16:37:11.369 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T16:37:11.428 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-07-29T16:37:11.486 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T16:37:11.486 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T16:37:11.486 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 375763 Links: 1 2023-07-29T16:37:11.486 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T16:37:11.487 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T16:37:11.487 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-29 16:36:45.325526526 +0000 2023-07-29T16:37:11.487 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-29 16:33:53.703092242 +0000 2023-07-29T16:37:11.487 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-29 16:33:53.703092242 +0000 2023-07-29T16:37:11.487 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-07-29T16:37:11.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T16:37:11.551 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-29T16:37:11.551 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-29T16:37:11.551 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00019817 s, 2.6 MB/s 2023-07-29T16:37:11.552 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T16:37:11.610 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:11.610 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-07-29T16:37:11.610 INFO:tasks.ceph:Generating config... 2023-07-29T16:37:11.612 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2023-07-29T16:37:11.612 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-29T16:37:11.612 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-29T16:37:11.612 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-29T16:37:11.613 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-29T16:37:11.613 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-29T16:37:11.613 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-29T16:37:11.613 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-07-29T16:37:11.613 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-29T16:37:11.614 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-29T16:37:11.614 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-29T16:37:11.614 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-29T16:37:11.614 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-29T16:37:11.614 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-29T16:37:11.615 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-29T16:37:11.615 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-29T16:37:11.615 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-29T16:37:11.615 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-29T16:37:11.615 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-07-29T16:37:11.616 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-29T16:37:11.616 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-07-29T16:37:11.616 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-29T16:37:11.616 INFO:tasks.ceph:Setting up mon.a... 2023-07-29T16:37:11.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-29T16:37:11.677 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2023-07-29T16:37:11.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-29T16:37:11.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T16:37:11.757 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.b', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.c', '[v2:172.21.15.70:3302,v1:172.21.15.70:6791]')] 2023-07-29T16:37:11.757 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2023-07-29T16:37:11.758 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:11.758 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T16:37:11.813 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv b '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --addv c '[v2:172.21.15.70:3302,v1:172.21.15.70:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:11.908 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:11.908 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = pacific 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:fsid c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2023-07-29T16:37:11.907103+0000 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:created 2023-07-29T16:37:11.907103+0000 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 16 (pacific) 2023-07-29T16:37:11.909 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2023-07-29T16:37:11.910 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2023-07-29T16:37:11.910 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.b 2023-07-29T16:37:11.910 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3302/0,v1:172.21.15.70:6791/0] mon.c 2023-07-29T16:37:11.910 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-29T16:37:11.911 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T16:37:11.927 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c7d00049-842a-4a32-8de6-3e4b9423aea7... 2023-07-29T16:37:11.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T16:37:11.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T16:37:11.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T16:37:11.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T16:37:12.012 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2023-07-29T16:37:12.012 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2023-07-29T16:37:12.013 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T16:37:12.014 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.015 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T16:37:12.016 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2023-07-29T16:37:12.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.018 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2023-07-29T16:37:12.019 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2023-07-29T16:37:12.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.020 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2023-07-29T16:37:12.020 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2023-07-29T16:37:12.020 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2023-07-29T16:37:12.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2023-07-29T16:37:12.021 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.022 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression algorithm = lz4 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression mode = aggressive 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2023-07-29T16:37:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2023-07-29T16:37:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-29T16:37:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.027 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2023-07-29T16:37:12.028 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T16:37:12.029 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2023-07-29T16:37:12.030 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2023-07-29T16:37:12.031 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2023-07-29T16:37:12.032 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T16:37:12.032 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T16:37:12.032 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2023-07-29T16:37:12.032 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2023-07-29T16:37:12.033 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2023-07-29T16:37:12.033 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-07-29T16:37:12.033 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-07-29T16:37:12.033 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-07-29T16:37:12.035 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2023-07-29T16:37:12.035 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2023-07-29T16:37:12.035 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T16:37:12.035 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2023-07-29T16:37:12.036 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.037 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2023-07-29T16:37:12.038 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2023-07-29T16:37:12.039 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2023-07-29T16:37:12.040 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.041 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.042 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2023-07-29T16:37:12.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.044 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression algorithm = lz4 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2023-07-29T16:37:12.045 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: osd blocked scrub grace period = 3600 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2023-07-29T16:37:12.046 INFO:teuthology.orchestra.run.smithi102.stdout: osd max markdown count = 1000 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-07-29T16:37:12.047 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-07-29T16:37:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.049 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T16:37:12.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2023-07-29T16:37:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2023-07-29T16:37:12.052 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-07-29T16:37:12.053 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-07-29T16:37:12.053 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-07-29T16:37:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-07-29T16:37:12.054 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-07-29T16:37:12.054 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T16:37:12.054 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-07-29T16:37:12.055 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.056 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T16:37:12.057 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T16:37:12.057 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.057 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-07-29T16:37:12.057 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-07-29T16:37:12.058 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-07-29T16:37:12.059 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:12.060 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-07-29T16:37:12.061 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.062 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-07-29T16:37:12.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-07-29T16:37:12.064 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression algorithm = lz4 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression mode = aggressive 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-07-29T16:37:12.065 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: osd blocked scrub grace period = 3600 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: osd max markdown count = 1000 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.066 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.067 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-07-29T16:37:12.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T16:37:12.069 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-07-29T16:37:12.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T16:37:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-07-29T16:37:12.072 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2023-07-29T16:37:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2023-07-29T16:37:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2023-07-29T16:37:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2023-07-29T16:37:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2023-07-29T16:37:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2023-07-29T16:37:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2023-07-29T16:37:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2023-07-29T16:37:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression algorithm = lz4 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2023-07-29T16:37:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2023-07-29T16:37:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-07-29T16:37:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T16:37:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2023-07-29T16:37:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2023-07-29T16:37:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2023-07-29T16:37:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2023-07-29T16:37:12.092 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-29T16:37:12.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-29T16:37:12.151 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-29T16:37:12.151 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:12.152 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-29T16:37:12.168 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:12.169 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-29T16:37:12.225 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2023-07-29T16:37:12.226 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:12.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T16:37:12.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T16:37:12.301 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:12.301 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:12.356 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2023-07-29T16:37:12.357 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:12.357 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T16:37:12.357 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T16:37:12.401 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:12.402 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:12.459 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2023-07-29T16:37:12.460 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:12.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T16:37:12.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T16:37:12.503 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:12.504 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:12.561 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:37:12.562 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:12.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T16:37:12.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T16:37:12.606 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:12.606 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:12.665 INFO:tasks.ceph:Setting up mon nodes... 2023-07-29T16:37:12.666 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-29T16:37:12.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T16:37:12.727 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T16:37:12.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T16:37:12.786 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T16:37:12.788 INFO:tasks.ceph:Setting up mds nodes... 2023-07-29T16:37:12.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T16:37:12.841 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T16:37:12.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-29T16:37:13.026 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-29T16:37:13.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-29T16:37:13.069 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-29T16:37:13.082 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-29T16:37:13.083 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-07-29T16:37:13.083 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-29T16:37:13.115 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:13.116 INFO:tasks.ceph:role: osd.0 2023-07-29T16:37:13.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-29T16:37:13.116 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T16:37:13.193 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T16:37:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T16:37:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T16:37:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T16:37:13.194 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T16:37:13.626 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-07-29T16:37:13.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-07-29T16:37:13.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-29T16:37:13.818 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-29T16:37:13.857 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:14.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.137+0000 7fc1ca00e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-29T16:37:14.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.137+0000 7fc1ca00e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-29T16:37:14.140 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.137+0000 7fc1ca00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T16:37:14.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.137+0000 7fc1ca00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T16:37:14.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.137+0000 7fc1ca00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T16:37:14.141 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-29T16:37:14.138+0000 7fc1ca00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-29T16:37:17.009 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-29T16:37:17.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-29T16:37:17.086 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:17.086 INFO:tasks.ceph:role: osd.1 2023-07-29T16:37:17.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2023-07-29T16:37:17.087 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T16:37:17.166 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T16:37:17.166 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T16:37:17.166 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T16:37:17.167 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T16:37:17.167 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T16:37:17.167 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-07-29T16:37:17.167 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T16:37:17.167 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T16:37:17.168 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T16:37:17.168 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T16:37:17.622 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-07-29T16:37:17.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-07-29T16:37:17.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-07-29T16:37:17.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-29T16:37:17.851 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:17.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.962+0000 7f1e670e6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-29T16:37:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.966+0000 7f1e670e6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-29T16:37:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.966+0000 7f1e670e6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T16:37:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.966+0000 7f1e670e6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T16:37:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.966+0000 7f1e670e6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T16:37:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-07-29T16:37:17.971+0000 7f1e670e6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-29T16:37:20.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-29T16:37:20.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-29T16:37:20.976 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-07-29T16:37:20.977 INFO:tasks.ceph:role: osd.2 2023-07-29T16:37:20.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:37:20.977 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T16:37:21.054 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T16:37:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T16:37:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T16:37:21.056 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T16:37:21.491 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-07-29T16:37:21.493 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-07-29T16:37:21.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-07-29T16:37:21.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-29T16:37:21.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:21.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.813+0000 7f4b049a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-29T16:37:21.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.815+0000 7f4b049a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-29T16:37:21.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.815+0000 7f4b049a2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T16:37:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.815+0000 7f4b049a2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T16:37:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.816+0000 7f4b049a2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T16:37:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-29T16:37:21.818+0000 7f4b049a2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-29T16:37:24.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-29T16:37:24.730 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-29T16:37:24.731 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:24.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-29T16:37:24.763 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:24.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-29T16:37:24.840 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:24.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-29T16:37:24.913 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:24.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-29T16:37:24.945 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:24.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-29T16:37:24.978 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:24.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-29T16:37:25.011 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-07-29T16:37:25.011 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-29T16:37:25.030 INFO:tasks.ceph:Adding keys to all mons... 2023-07-29T16:37:25.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-29T16:37:25.098 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2023-07-29T16:37:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA4QMVk+8ZLKxAAjfClWmRZDqZv4pYC5OZ/Fw== 2023-07-29T16:37:25.098 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2023-07-29T16:37:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA4QMVkiCjLLhAAqns8EVcnTOplGXCS1YNBEg== 2023-07-29T16:37:25.098 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA4QMVk5xscMhAAhDgsSzlEX1bJ/043WuAy/g== 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA6QMVk5BxICBAAgwpi6QyiobFVhed+iNPPdw== 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA9QMVkKpl2ORAAJDLpDr/ojcLQWi6YdgsE3g== 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2023-07-29T16:37:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBBQMVkP1OHMBAA2jc4044Jw0HttYy2X9hZHQ== 2023-07-29T16:37:25.100 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-07-29T16:37:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQA5QMVkg44TBBAAJjH3gRlq90t3Krh6/jq8PA== 2023-07-29T16:37:25.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T16:37:25.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T16:37:25.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T16:37:25.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T16:37:25.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T16:37:25.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T16:37:25.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-29T16:37:25.591 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-29T16:37:25.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-29T16:37:25.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T16:37:25.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-29T16:37:25.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-29T16:37:25.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T16:37:26.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-29T16:37:26.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-29T16:37:26.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T16:37:26.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-29T16:37:26.293 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:37:26.349 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-29T16:37:26.349 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-29T16:37:26.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-29T16:37:26.391 INFO:tasks.ceph.mon.a:Started 2023-07-29T16:37:26.391 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-29T16:37:26.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-29T16:37:26.394 INFO:tasks.ceph.mon.b:Started 2023-07-29T16:37:26.394 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-29T16:37:26.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-29T16:37:26.397 INFO:tasks.ceph.mon.c:Started 2023-07-29T16:37:26.397 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-29T16:37:26.398 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-29T16:37:26.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-29T16:37:26.400 INFO:tasks.ceph.mgr.x:Started 2023-07-29T16:37:26.401 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-29T16:37:26.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-29T16:37:26.403 INFO:tasks.ceph.mgr.y:Started 2023-07-29T16:37:26.403 INFO:tasks.ceph:Setting crush tunables to default 2023-07-29T16:37:26.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2023-07-29T16:37:31.846 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2023-07-29T16:37:31.858 INFO:tasks.ceph:check_enable_crimson: False 2023-07-29T16:37:31.858 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-29T16:37:31.859 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-29T16:37:31.859 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-29T16:37:31.882 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:31.880+0000 7f5bb0caa200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T16:37:31.892 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-07-29T16:37:31.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-29T16:37:31.924 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-29T16:37:31.925 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-29T16:37:31.947 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:31.946+0000 7f5bb0caa200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T16:37:31.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 8b382307-786b-44f2-86db-ca9158b22127 0 2023-07-29T16:37:32.023 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.021+0000 7f5bb0caa200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T16:37:32.100 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.098+0000 7f5bb0caa200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T16:37:32.212 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-07-29T16:37:32.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new f63dfc0a-a0cd-41f1-84c7-3a2da78625a4 1 2023-07-29T16:37:32.243 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.241+0000 7f5bb0caa200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T16:37:32.432 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-07-29T16:37:32.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 659e5b83-bc39-4700-81b4-3cf949380228 2 2023-07-29T16:37:32.580 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.579+0000 7f5bb0caa200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T16:37:32.617 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:32.615+0000 7fa0163ee200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T16:37:32.654 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-07-29T16:37:32.659 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.657+0000 7f5bb0caa200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T16:37:32.667 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-29T16:37:32.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-29T16:37:32.669 INFO:tasks.ceph.osd.0:Started 2023-07-29T16:37:32.670 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-29T16:37:32.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-29T16:37:32.672 INFO:tasks.ceph.osd.1:Started 2023-07-29T16:37:32.673 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-29T16:37:32.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-29T16:37:32.675 INFO:tasks.ceph.osd.2:Started 2023-07-29T16:37:32.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:32.687 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:32.685+0000 7fa0163ee200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T16:37:32.765 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:32.764+0000 7fa0163ee200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T16:37:32.798 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.796+0000 7f5bb0caa200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T16:37:32.849 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:32.848+0000 7fa0163ee200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T16:37:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:32.882 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:32.650908+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:32.884 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:32.882+0000 7f5bb0caa200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T16:37:32.895 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-29T16:37:32.895 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-29T16:37:32.996 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:32.994+0000 7fa0163ee200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T16:37:33.197 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:33.267 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:37:33.264+0000 7f626091a640 -1 Falling back to public interface 2023-07-29T16:37:33.274 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:37:33.273+0000 7f0b103d7640 -1 Falling back to public interface 2023-07-29T16:37:33.279 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:37:33.277+0000 7f2493df0640 -1 Falling back to public interface 2023-07-29T16:37:33.304 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:33.302+0000 7fa0163ee200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T16:37:33.347 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:33.346+0000 7f5bb0caa200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T16:37:33.382 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:33.380+0000 7fa0163ee200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T16:37:33.387 INFO:teuthology.misc.health.smithi070.stdout: 2023-07-29T16:37:33.388 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":5,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:32.650908+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:33.401 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-29T16:37:33.504 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:33.503+0000 7fa0163ee200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T16:37:33.586 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:33.584+0000 7fa0163ee200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T16:37:33.948 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:33.947+0000 7f5bb0caa200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T16:37:34.005 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:34.003+0000 7fa0163ee200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T16:37:34.112 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:34.110+0000 7f5bb0caa200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T16:37:34.502 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:34.501+0000 7fa0163ee200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T16:37:34.661 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:34.659+0000 7fa0163ee200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T16:37:34.839 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:34.837+0000 7f5bb0caa200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T16:37:34.919 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:34.917+0000 7f5bb0caa200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T16:37:35.062 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:35.061+0000 7f5bb0caa200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T16:37:35.306 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:35.304+0000 7fa0163ee200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T16:37:35.309 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:35.307+0000 7f5bb0caa200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T16:37:35.386 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:35.384+0000 7f5bb0caa200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T16:37:35.386 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:35.384+0000 7fa0163ee200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T16:37:35.533 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:35.531+0000 7fa0163ee200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T16:37:35.665 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:35.664+0000 7f5bb0caa200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T16:37:35.761 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:35.759+0000 7fa0163ee200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T16:37:35.836 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:35.835+0000 7fa0163ee200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T16:37:35.891 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:35.889+0000 7f5bb0caa200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T16:37:36.056 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:36.054+0000 7f5bb0caa200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T16:37:36.108 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:36.106+0000 7fa0163ee200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T16:37:36.176 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:36.174+0000 7f5bb0caa200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T16:37:36.333 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:36.331+0000 7fa0163ee200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T16:37:36.489 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:36.488+0000 7fa0163ee200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T16:37:36.508 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:36.506+0000 7f5bb0caa200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T16:37:36.607 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:36.605+0000 7fa0163ee200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T16:37:36.612 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:36.611+0000 7f5bb0caa200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T16:37:36.738 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:37:36.735+0000 7f626091a640 -1 osd.2 0 log_to_monitors true 2023-07-29T16:37:36.742 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:37:36.739+0000 7f2493df0640 -1 osd.1 0 log_to_monitors true 2023-07-29T16:37:36.743 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:37:36.742+0000 7f0b103d7640 -1 osd.0 0 log_to_monitors true 2023-07-29T16:37:36.763 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:36.761+0000 7fa0163ee200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T16:37:36.805 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:36.803+0000 7f5bb0caa200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T16:37:37.031 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:37.030+0000 7fa0163ee200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T16:37:37.206 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:37.204+0000 7fa0163ee200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T16:37:37.435 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:37.433+0000 7f5bb0caa200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T16:37:37.743 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-07-29T16:37:37.741+0000 7fa0163ee200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T16:37:38.461 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:38.459+0000 7f5b68ed7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-29T16:37:38.462 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:37:38.460+0000 7f5b68ed7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-29T16:37:39.263 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:37:39.262+0000 7f0b04f90700 -1 osd.0 0 waiting for initial osdmap 2023-07-29T16:37:39.278 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:37:39.276+0000 7f0afc369700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T16:37:39.281 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:37:39.279+0000 7f24889a9700 -1 osd.1 0 waiting for initial osdmap 2023-07-29T16:37:39.292 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:37:39.290+0000 7f247fd82700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T16:37:39.693 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:37:39.690+0000 7f6254cd2700 -1 osd.2 0 waiting for initial osdmap 2023-07-29T16:37:39.702 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:37:39.700+0000 7f624c8ac700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T16:37:39.704 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:40.023 INFO:teuthology.misc.health.smithi070.stdout: 2023-07-29T16:37:40.023 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":7,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:38.496570+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:40.035 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-29T16:37:46.338 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:46.661 INFO:teuthology.misc.health.smithi070.stdout: 2023-07-29T16:37:46.661 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":11,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:43.517958+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:46.673 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-07-29T16:37:46.674 INFO:tasks.ceph:Creating RBD pool 2023-07-29T16:37:46.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-29T16:37:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2023-07-29T16:37:47.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-29T16:37:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-29T16:37:48.553 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-29T16:37:48.554 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-29T16:37:48.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-29T16:37:48.557 INFO:tasks.ceph.mds.a:Started 2023-07-29T16:37:48.557 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-29T16:37:48.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:48.639 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-07-29T16:37:48.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:48.886 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:48.529630+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:48.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T16:37:48.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T16:37:49.218 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-07-29T16:37:49.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T16:37:49.552 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 8 2023-07-29T16:37:49.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T16:37:49.927 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:49.927 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6803/4082681389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4082681389},{"type":"v1","addr":"172.21.15.70:6803","nonce":4082681389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-29T16:37:49.929 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2023-07-29T16:37:49.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:50.256 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:50.256 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":14,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:49.535223+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:50.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T16:37:50.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T16:37:50.591 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-07-29T16:37:50.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T16:37:50.947 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 8 2023-07-29T16:37:50.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-29T16:37:51.281 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:51.281 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-07-29T16:37:51.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 2, 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": "rbd" 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:37:51.282 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-07-29T16:37:51.295 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-29T16:37:51.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-29T16:37:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-07-29T16:37:52.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-29T16:37:53.561 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-07-29T16:37:53.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-29T16:37:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 3 and data pool 4 2023-07-29T16:37:53.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:54.274 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:54.275 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:53.940978+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:54.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:54.609 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:54.609 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:53.940978+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:54.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-29T16:37:55.973 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-29T16:37:55.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-29T16:37:56.972 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-29T16:37:56.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T16:37:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:57.339 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T16:37:53.941272+0000","modified":"2023-07-29T16:37:56.950204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6803/4082681389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4082681389},{"type":"v1","addr":"172.21.15.70:6803","nonce":4082681389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T16:37:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2023-07-29T16:37:57.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:57.670 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:57.683 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-29T16:37:57.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:37:58.013 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:37:58.023 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-29T16:37:57.454896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81464,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034056,"statfs":{"total":289910292480,"available":289826873344,"internally_reserved":0,"allocated":622592,"data_stored":1336879,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906720"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960246+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:53.960246+0000","last_peered":"2023-07-29T16:37:53.960246+0000","last_clean":"2023-07-29T16:37:53.960246+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:53.960246+0000","last_undegraded":"2023-07-29T16:37:53.960246+0000","last_fullsized":"2023-07-29T16:37:53.960246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959608+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:53.959608+0000","last_peered":"2023-07-29T16:37:53.959608+0000","last_clean":"2023-07-29T16:37:53.959608+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:53.959608+0000","last_undegraded":"2023-07-29T16:37:53.959608+0000","last_fullsized":"2023-07-29T16:37:53.959608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952442+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:53.952442+0000","last_peered":"2023-07-29T16:37:53.952442+0000","last_clean":"2023-07-29T16:37:53.952442+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:53.952442+0000","last_undegraded":"2023-07-29T16:37:53.952442+0000","last_fullsized":"2023-07-29T16:37:53.952442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956793+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:53.956793+0000","last_peered":"2023-07-29T16:37:53.956793+0000","last_clean":"2023-07-29T16:37:53.956793+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:53.956793+0000","last_undegraded":"2023-07-29T16:37:53.956793+0000","last_fullsized":"2023-07-29T16:37:53.956793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958702+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:53.958702+0000","last_peered":"2023-07-29T16:37:53.958702+0000","last_clean":"2023-07-29T16:37:53.958702+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:53.958702+0000","last_undegraded":"2023-07-29T16:37:53.958702+0000","last_fullsized":"2023-07-29T16:37:53.958702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945125+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:53.945125+0000","last_peered":"2023-07-29T16:37:53.945125+0000","last_clean":"2023-07-29T16:37:53.945125+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:53.945125+0000","last_undegraded":"2023-07-29T16:37:53.945125+0000","last_fullsized":"2023-07-29T16:37:53.945125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956828+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:53.956828+0000","last_peered":"2023-07-29T16:37:53.956828+0000","last_clean":"2023-07-29T16:37:53.956828+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:53.956828+0000","last_undegraded":"2023-07-29T16:37:53.956828+0000","last_fullsized":"2023-07-29T16:37:53.956828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944427+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:53.944427+0000","last_peered":"2023-07-29T16:37:53.944427+0000","last_clean":"2023-07-29T16:37:53.944427+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:53.944427+0000","last_undegraded":"2023-07-29T16:37:53.944427+0000","last_fullsized":"2023-07-29T16:37:53.944427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946338+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:53.946338+0000","last_peered":"2023-07-29T16:37:53.946338+0000","last_clean":"2023-07-29T16:37:53.946338+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:53.946338+0000","last_undegraded":"2023-07-29T16:37:53.946338+0000","last_fullsized":"2023-07-29T16:37:53.946338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959314+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:53.959314+0000","last_peered":"2023-07-29T16:37:53.959314+0000","last_clean":"2023-07-29T16:37:53.959314+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:53.959314+0000","last_undegraded":"2023-07-29T16:37:53.959314+0000","last_fullsized":"2023-07-29T16:37:53.959314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957645+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:53.957645+0000","last_peered":"2023-07-29T16:37:53.957645+0000","last_clean":"2023-07-29T16:37:53.957645+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:53.957645+0000","last_undegraded":"2023-07-29T16:37:53.957645+0000","last_fullsized":"2023-07-29T16:37:53.957645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959507+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:53.959507+0000","last_peered":"2023-07-29T16:37:53.959507+0000","last_clean":"2023-07-29T16:37:53.959507+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:53.959507+0000","last_undegraded":"2023-07-29T16:37:53.959507+0000","last_fullsized":"2023-07-29T16:37:53.959507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944806+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:53.944806+0000","last_peered":"2023-07-29T16:37:53.944806+0000","last_clean":"2023-07-29T16:37:53.944806+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:53.944806+0000","last_undegraded":"2023-07-29T16:37:53.944806+0000","last_fullsized":"2023-07-29T16:37:53.944806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958679+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:53.958679+0000","last_peered":"2023-07-29T16:37:53.958679+0000","last_clean":"2023-07-29T16:37:53.958679+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:53.958679+0000","last_undegraded":"2023-07-29T16:37:53.958679+0000","last_fullsized":"2023-07-29T16:37:53.958679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959269+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:53.959269+0000","last_peered":"2023-07-29T16:37:53.959269+0000","last_clean":"2023-07-29T16:37:53.959269+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:53.959269+0000","last_undegraded":"2023-07-29T16:37:53.959269+0000","last_fullsized":"2023-07-29T16:37:53.959269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957133+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:53.957133+0000","last_peered":"2023-07-29T16:37:53.957133+0000","last_clean":"2023-07-29T16:37:53.957133+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:53.957133+0000","last_undegraded":"2023-07-29T16:37:53.957133+0000","last_fullsized":"2023-07-29T16:37:53.957133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.955118+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:53.955118+0000","last_peered":"2023-07-29T16:37:53.955118+0000","last_clean":"2023-07-29T16:37:53.955118+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:53.955118+0000","last_undegraded":"2023-07-29T16:37:53.955118+0000","last_fullsized":"2023-07-29T16:37:53.955118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960583+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:53.960583+0000","last_peered":"2023-07-29T16:37:53.960583+0000","last_clean":"2023-07-29T16:37:53.960583+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:53.960583+0000","last_undegraded":"2023-07-29T16:37:53.960583+0000","last_fullsized":"2023-07-29T16:37:53.960583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.563091+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.563091+0000","last_peered":"2023-07-29T16:37:53.563091+0000","last_clean":"2023-07-29T16:37:53.563091+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.563091+0000","last_undegraded":"2023-07-29T16:37:53.563091+0000","last_fullsized":"2023-07-29T16:37:53.563091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959236+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:53.959236+0000","last_peered":"2023-07-29T16:37:53.959236+0000","last_clean":"2023-07-29T16:37:53.959236+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:53.959236+0000","last_undegraded":"2023-07-29T16:37:53.959236+0000","last_fullsized":"2023-07-29T16:37:53.959236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.563331+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.563331+0000","last_peered":"2023-07-29T16:37:53.563331+0000","last_clean":"2023-07-29T16:37:53.563331+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.563331+0000","last_undegraded":"2023-07-29T16:37:53.563331+0000","last_fullsized":"2023-07-29T16:37:53.563331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960554+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:53.960554+0000","last_peered":"2023-07-29T16:37:53.960554+0000","last_clean":"2023-07-29T16:37:53.960554+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:53.960554+0000","last_undegraded":"2023-07-29T16:37:53.960554+0000","last_fullsized":"2023-07-29T16:37:53.960554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944558+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:53.944558+0000","last_peered":"2023-07-29T16:37:53.944558+0000","last_clean":"2023-07-29T16:37:53.944558+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:53.944558+0000","last_undegraded":"2023-07-29T16:37:53.944558+0000","last_fullsized":"2023-07-29T16:37:53.944558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944475+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:53.944475+0000","last_peered":"2023-07-29T16:37:53.944475+0000","last_clean":"2023-07-29T16:37:53.944475+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:53.944475+0000","last_undegraded":"2023-07-29T16:37:53.944475+0000","last_fullsized":"2023-07-29T16:37:53.944475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945179+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:53.945179+0000","last_peered":"2023-07-29T16:37:53.945179+0000","last_clean":"2023-07-29T16:37:53.945179+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:53.945179+0000","last_undegraded":"2023-07-29T16:37:53.945179+0000","last_fullsized":"2023-07-29T16:37:53.945179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958871+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:53.958871+0000","last_peered":"2023-07-29T16:37:53.958871+0000","last_clean":"2023-07-29T16:37:53.958871+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:53.958871+0000","last_undegraded":"2023-07-29T16:37:53.958871+0000","last_fullsized":"2023-07-29T16:37:53.958871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.564234+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.564234+0000","last_peered":"2023-07-29T16:37:53.564234+0000","last_clean":"2023-07-29T16:37:53.564234+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.564234+0000","last_undegraded":"2023-07-29T16:37:53.564234+0000","last_fullsized":"2023-07-29T16:37:53.564234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957471+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:53.957471+0000","last_peered":"2023-07-29T16:37:53.957471+0000","last_clean":"2023-07-29T16:37:53.957471+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:53.957471+0000","last_undegraded":"2023-07-29T16:37:53.957471+0000","last_fullsized":"2023-07-29T16:37:53.957471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945917+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:53.945917+0000","last_peered":"2023-07-29T16:37:53.945917+0000","last_clean":"2023-07-29T16:37:53.945917+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:53.945917+0000","last_undegraded":"2023-07-29T16:37:53.945917+0000","last_fullsized":"2023-07-29T16:37:53.945917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956748+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:53.956748+0000","last_peered":"2023-07-29T16:37:53.956748+0000","last_clean":"2023-07-29T16:37:53.956748+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:53.956748+0000","last_undegraded":"2023-07-29T16:37:53.956748+0000","last_fullsized":"2023-07-29T16:37:53.956748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959729+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:53.959729+0000","last_peered":"2023-07-29T16:37:53.959729+0000","last_clean":"2023-07-29T16:37:53.959729+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:53.959729+0000","last_undegraded":"2023-07-29T16:37:53.959729+0000","last_fullsized":"2023-07-29T16:37:53.959729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959594+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:53.959594+0000","last_peered":"2023-07-29T16:37:53.959594+0000","last_clean":"2023-07-29T16:37:53.959594+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:53.959594+0000","last_undegraded":"2023-07-29T16:37:53.959594+0000","last_fullsized":"2023-07-29T16:37:53.959594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960127+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:53.960127+0000","last_peered":"2023-07-29T16:37:53.960127+0000","last_clean":"2023-07-29T16:37:53.960127+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:53.960127+0000","last_undegraded":"2023-07-29T16:37:53.960127+0000","last_fullsized":"2023-07-29T16:37:53.960127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":51089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":642587,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":643203,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:37:58.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:37:58.383 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:58.384 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:37:58.395 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-29T16:37:57.454896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81464,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034056,"statfs":{"total":289910292480,"available":289826873344,"internally_reserved":0,"allocated":622592,"data_stored":1336879,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.906720"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960246+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:53.960246+0000","last_peered":"2023-07-29T16:37:53.960246+0000","last_clean":"2023-07-29T16:37:53.960246+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:53.960246+0000","last_undegraded":"2023-07-29T16:37:53.960246+0000","last_fullsized":"2023-07-29T16:37:53.960246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959608+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:53.959608+0000","last_peered":"2023-07-29T16:37:53.959608+0000","last_clean":"2023-07-29T16:37:53.959608+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:53.959608+0000","last_undegraded":"2023-07-29T16:37:53.959608+0000","last_fullsized":"2023-07-29T16:37:53.959608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952442+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:53.952442+0000","last_peered":"2023-07-29T16:37:53.952442+0000","last_clean":"2023-07-29T16:37:53.952442+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:53.952442+0000","last_undegraded":"2023-07-29T16:37:53.952442+0000","last_fullsized":"2023-07-29T16:37:53.952442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956793+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:53.956793+0000","last_peered":"2023-07-29T16:37:53.956793+0000","last_clean":"2023-07-29T16:37:53.956793+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:53.956793+0000","last_undegraded":"2023-07-29T16:37:53.956793+0000","last_fullsized":"2023-07-29T16:37:53.956793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958702+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:53.958702+0000","last_peered":"2023-07-29T16:37:53.958702+0000","last_clean":"2023-07-29T16:37:53.958702+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:53.958702+0000","last_undegraded":"2023-07-29T16:37:53.958702+0000","last_fullsized":"2023-07-29T16:37:53.958702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945125+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:53.945125+0000","last_peered":"2023-07-29T16:37:53.945125+0000","last_clean":"2023-07-29T16:37:53.945125+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:53.945125+0000","last_undegraded":"2023-07-29T16:37:53.945125+0000","last_fullsized":"2023-07-29T16:37:53.945125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956828+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:53.956828+0000","last_peered":"2023-07-29T16:37:53.956828+0000","last_clean":"2023-07-29T16:37:53.956828+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:53.956828+0000","last_undegraded":"2023-07-29T16:37:53.956828+0000","last_fullsized":"2023-07-29T16:37:53.956828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944427+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:53.944427+0000","last_peered":"2023-07-29T16:37:53.944427+0000","last_clean":"2023-07-29T16:37:53.944427+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:53.944427+0000","last_undegraded":"2023-07-29T16:37:53.944427+0000","last_fullsized":"2023-07-29T16:37:53.944427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946338+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:53.946338+0000","last_peered":"2023-07-29T16:37:53.946338+0000","last_clean":"2023-07-29T16:37:53.946338+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:53.946338+0000","last_undegraded":"2023-07-29T16:37:53.946338+0000","last_fullsized":"2023-07-29T16:37:53.946338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959314+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:53.959314+0000","last_peered":"2023-07-29T16:37:53.959314+0000","last_clean":"2023-07-29T16:37:53.959314+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:53.959314+0000","last_undegraded":"2023-07-29T16:37:53.959314+0000","last_fullsized":"2023-07-29T16:37:53.959314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957645+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:53.957645+0000","last_peered":"2023-07-29T16:37:53.957645+0000","last_clean":"2023-07-29T16:37:53.957645+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:53.957645+0000","last_undegraded":"2023-07-29T16:37:53.957645+0000","last_fullsized":"2023-07-29T16:37:53.957645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959507+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:53.959507+0000","last_peered":"2023-07-29T16:37:53.959507+0000","last_clean":"2023-07-29T16:37:53.959507+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:53.959507+0000","last_undegraded":"2023-07-29T16:37:53.959507+0000","last_fullsized":"2023-07-29T16:37:53.959507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944806+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:53.944806+0000","last_peered":"2023-07-29T16:37:53.944806+0000","last_clean":"2023-07-29T16:37:53.944806+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:53.944806+0000","last_undegraded":"2023-07-29T16:37:53.944806+0000","last_fullsized":"2023-07-29T16:37:53.944806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958679+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:53.958679+0000","last_peered":"2023-07-29T16:37:53.958679+0000","last_clean":"2023-07-29T16:37:53.958679+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:53.958679+0000","last_undegraded":"2023-07-29T16:37:53.958679+0000","last_fullsized":"2023-07-29T16:37:53.958679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959269+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:53.959269+0000","last_peered":"2023-07-29T16:37:53.959269+0000","last_clean":"2023-07-29T16:37:53.959269+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:53.959269+0000","last_undegraded":"2023-07-29T16:37:53.959269+0000","last_fullsized":"2023-07-29T16:37:53.959269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957133+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:53.957133+0000","last_peered":"2023-07-29T16:37:53.957133+0000","last_clean":"2023-07-29T16:37:53.957133+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:53.957133+0000","last_undegraded":"2023-07-29T16:37:53.957133+0000","last_fullsized":"2023-07-29T16:37:53.957133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.955118+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:53.955118+0000","last_peered":"2023-07-29T16:37:53.955118+0000","last_clean":"2023-07-29T16:37:53.955118+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:53.955118+0000","last_undegraded":"2023-07-29T16:37:53.955118+0000","last_fullsized":"2023-07-29T16:37:53.955118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960583+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:53.960583+0000","last_peered":"2023-07-29T16:37:53.960583+0000","last_clean":"2023-07-29T16:37:53.960583+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:53.960583+0000","last_undegraded":"2023-07-29T16:37:53.960583+0000","last_fullsized":"2023-07-29T16:37:53.960583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.563091+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.563091+0000","last_peered":"2023-07-29T16:37:53.563091+0000","last_clean":"2023-07-29T16:37:53.563091+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.563091+0000","last_undegraded":"2023-07-29T16:37:53.563091+0000","last_fullsized":"2023-07-29T16:37:53.563091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959236+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:53.959236+0000","last_peered":"2023-07-29T16:37:53.959236+0000","last_clean":"2023-07-29T16:37:53.959236+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:53.959236+0000","last_undegraded":"2023-07-29T16:37:53.959236+0000","last_fullsized":"2023-07-29T16:37:53.959236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.563331+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.563331+0000","last_peered":"2023-07-29T16:37:53.563331+0000","last_clean":"2023-07-29T16:37:53.563331+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.563331+0000","last_undegraded":"2023-07-29T16:37:53.563331+0000","last_fullsized":"2023-07-29T16:37:53.563331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960554+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:53.960554+0000","last_peered":"2023-07-29T16:37:53.960554+0000","last_clean":"2023-07-29T16:37:53.960554+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:53.960554+0000","last_undegraded":"2023-07-29T16:37:53.960554+0000","last_fullsized":"2023-07-29T16:37:53.960554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944558+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:53.944558+0000","last_peered":"2023-07-29T16:37:53.944558+0000","last_clean":"2023-07-29T16:37:53.944558+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:53.944558+0000","last_undegraded":"2023-07-29T16:37:53.944558+0000","last_fullsized":"2023-07-29T16:37:53.944558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944475+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:53.944475+0000","last_peered":"2023-07-29T16:37:53.944475+0000","last_clean":"2023-07-29T16:37:53.944475+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:53.944475+0000","last_undegraded":"2023-07-29T16:37:53.944475+0000","last_fullsized":"2023-07-29T16:37:53.944475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945179+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:53.945179+0000","last_peered":"2023-07-29T16:37:53.945179+0000","last_clean":"2023-07-29T16:37:53.945179+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:53.945179+0000","last_undegraded":"2023-07-29T16:37:53.945179+0000","last_fullsized":"2023-07-29T16:37:53.945179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.958871+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:53.958871+0000","last_peered":"2023-07-29T16:37:53.958871+0000","last_clean":"2023-07-29T16:37:53.958871+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:53.958871+0000","last_undegraded":"2023-07-29T16:37:53.958871+0000","last_fullsized":"2023-07-29T16:37:53.958871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.564234+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.564234+0000","last_peered":"2023-07-29T16:37:53.564234+0000","last_clean":"2023-07-29T16:37:53.564234+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.564234+0000","last_undegraded":"2023-07-29T16:37:53.564234+0000","last_fullsized":"2023-07-29T16:37:53.564234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957471+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:53.957471+0000","last_peered":"2023-07-29T16:37:53.957471+0000","last_clean":"2023-07-29T16:37:53.957471+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:53.957471+0000","last_undegraded":"2023-07-29T16:37:53.957471+0000","last_fullsized":"2023-07-29T16:37:53.957471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945917+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:53.945917+0000","last_peered":"2023-07-29T16:37:53.945917+0000","last_clean":"2023-07-29T16:37:53.945917+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:53.945917+0000","last_undegraded":"2023-07-29T16:37:53.945917+0000","last_fullsized":"2023-07-29T16:37:53.945917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.956748+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:53.956748+0000","last_peered":"2023-07-29T16:37:53.956748+0000","last_clean":"2023-07-29T16:37:53.956748+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:53.956748+0000","last_undegraded":"2023-07-29T16:37:53.956748+0000","last_fullsized":"2023-07-29T16:37:53.956748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959729+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:53.959729+0000","last_peered":"2023-07-29T16:37:53.959729+0000","last_clean":"2023-07-29T16:37:53.959729+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:53.959729+0000","last_undegraded":"2023-07-29T16:37:53.959729+0000","last_fullsized":"2023-07-29T16:37:53.959729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.959594+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:53.959594+0000","last_peered":"2023-07-29T16:37:53.959594+0000","last_clean":"2023-07-29T16:37:53.959594+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:53.959594+0000","last_undegraded":"2023-07-29T16:37:53.959594+0000","last_fullsized":"2023-07-29T16:37:53.959594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.960127+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:53.960127+0000","last_peered":"2023-07-29T16:37:53.960127+0000","last_clean":"2023-07-29T16:37:53.960127+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:53.960127+0000","last_undegraded":"2023-07-29T16:37:53.960127+0000","last_fullsized":"2023-07-29T16:37:53.960127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":51089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":642587,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":643203,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:37:58.401 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-29T16:37:58.401 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-29T16:37:58.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-29T16:37:58.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-29T16:37:58.402 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-29T16:37:58.659 INFO:tasks.ceph.mds.a.smithi070.stderr:2023-07-29T16:37:58.656+0000 7ff06eaaf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T16:37:58.811 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:58.822 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":93974},{"type":"v1","addr":"172.21.15.70:6801","nonce":93974}]},"active_addr":"172.21.15.70:6801/93974","active_change":"2023-07-29T16:37:37.447478+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4121,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3273784720}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3787524033}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":4002009277}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":467540802}]}]} 2023-07-29T16:37:58.829 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-29T16:37:58.830 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-29T16:37:58.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:59.151 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:59.151 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:59.165 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-29T16:37:59.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:37:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:37:59.485 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:37:59.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-29T16:37:59.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-29T16:37:59.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-29T16:37:59.663 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2023-07-29T16:37:59.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T16:37:59.686 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2023-07-29T16:37:59.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T16:37:59.688 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2023-07-29T16:37:59.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T16:38:00.008 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:00.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2023-07-29T16:38:00.067 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:00.072 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:00.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2023-07-29T16:38:00.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2023-07-29T16:38:01.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T16:38:01.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T16:38:01.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T16:38:01.378 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:01.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2023-07-29T16:38:01.433 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:01.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2023-07-29T16:38:01.478 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2023-07-29T16:38:01.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2023-07-29T16:38:02.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T16:38:02.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T16:38:02.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T16:38:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:34359738376 2023-07-29T16:38:02.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.0 2023-07-29T16:38:02.771 DEBUG:teuthology.parallel:result is None 2023-07-29T16:38:02.794 INFO:teuthology.orchestra.run.smithi070.stdout:34359738376 2023-07-29T16:38:02.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.2 2023-07-29T16:38:02.809 DEBUG:teuthology.parallel:result is None 2023-07-29T16:38:02.838 INFO:teuthology.orchestra.run.smithi070.stdout:34359738376 2023-07-29T16:38:02.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.1 2023-07-29T16:38:02.852 DEBUG:teuthology.parallel:result is None 2023-07-29T16:38:02.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T16:38:02.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:03.217 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:03.218 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:03.228 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-29T16:38:01.455654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81488,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034032,"statfs":{"total":289910292480,"available":289826848768,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.902231"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508425+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:55.508425+0000","last_peered":"2023-07-29T16:37:55.508425+0000","last_clean":"2023-07-29T16:37:55.508425+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:55.508425+0000","last_undegraded":"2023-07-29T16:37:55.508425+0000","last_fullsized":"2023-07-29T16:37:55.508425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508436+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:55.508436+0000","last_peered":"2023-07-29T16:37:55.508436+0000","last_clean":"2023-07-29T16:37:55.508436+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:55.508436+0000","last_undegraded":"2023-07-29T16:37:55.508436+0000","last_fullsized":"2023-07-29T16:37:55.508436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508340+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:55.508340+0000","last_peered":"2023-07-29T16:37:55.508340+0000","last_clean":"2023-07-29T16:37:55.508340+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:55.508340+0000","last_undegraded":"2023-07-29T16:37:55.508340+0000","last_fullsized":"2023-07-29T16:37:55.508340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508183+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:55.508183+0000","last_peered":"2023-07-29T16:37:55.508183+0000","last_clean":"2023-07-29T16:37:55.508183+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:55.508183+0000","last_undegraded":"2023-07-29T16:37:55.508183+0000","last_fullsized":"2023-07-29T16:37:55.508183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508351+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:55.508351+0000","last_peered":"2023-07-29T16:37:55.508351+0000","last_clean":"2023-07-29T16:37:55.508351+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:55.508351+0000","last_undegraded":"2023-07-29T16:37:55.508351+0000","last_fullsized":"2023-07-29T16:37:55.508351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508197+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:55.508197+0000","last_peered":"2023-07-29T16:37:55.508197+0000","last_clean":"2023-07-29T16:37:55.508197+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:55.508197+0000","last_undegraded":"2023-07-29T16:37:55.508197+0000","last_fullsized":"2023-07-29T16:37:55.508197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508382+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:55.508382+0000","last_peered":"2023-07-29T16:37:55.508382+0000","last_clean":"2023-07-29T16:37:55.508382+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:55.508382+0000","last_undegraded":"2023-07-29T16:37:55.508382+0000","last_fullsized":"2023-07-29T16:37:55.508382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508119+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:55.508119+0000","last_peered":"2023-07-29T16:37:55.508119+0000","last_clean":"2023-07-29T16:37:55.508119+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:55.508119+0000","last_undegraded":"2023-07-29T16:37:55.508119+0000","last_fullsized":"2023-07-29T16:37:55.508119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508492+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:55.508492+0000","last_peered":"2023-07-29T16:37:55.508492+0000","last_clean":"2023-07-29T16:37:55.508492+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:55.508492+0000","last_undegraded":"2023-07-29T16:37:55.508492+0000","last_fullsized":"2023-07-29T16:37:55.508492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508129+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:55.508129+0000","last_peered":"2023-07-29T16:37:55.508129+0000","last_clean":"2023-07-29T16:37:55.508129+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:55.508129+0000","last_undegraded":"2023-07-29T16:37:55.508129+0000","last_fullsized":"2023-07-29T16:37:55.508129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508207+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:55.508207+0000","last_peered":"2023-07-29T16:37:55.508207+0000","last_clean":"2023-07-29T16:37:55.508207+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:55.508207+0000","last_undegraded":"2023-07-29T16:37:55.508207+0000","last_fullsized":"2023-07-29T16:37:55.508207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508233+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:55.508233+0000","last_peered":"2023-07-29T16:37:55.508233+0000","last_clean":"2023-07-29T16:37:55.508233+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:55.508233+0000","last_undegraded":"2023-07-29T16:37:55.508233+0000","last_fullsized":"2023-07-29T16:37:55.508233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508248+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:55.508248+0000","last_peered":"2023-07-29T16:37:55.508248+0000","last_clean":"2023-07-29T16:37:55.508248+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:55.508248+0000","last_undegraded":"2023-07-29T16:37:55.508248+0000","last_fullsized":"2023-07-29T16:37:55.508248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508394+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:55.508394+0000","last_peered":"2023-07-29T16:37:55.508394+0000","last_clean":"2023-07-29T16:37:55.508394+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:55.508394+0000","last_undegraded":"2023-07-29T16:37:55.508394+0000","last_fullsized":"2023-07-29T16:37:55.508394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508514+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:55.508514+0000","last_peered":"2023-07-29T16:37:55.508514+0000","last_clean":"2023-07-29T16:37:55.508514+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:55.508514+0000","last_undegraded":"2023-07-29T16:37:55.508514+0000","last_fullsized":"2023-07-29T16:37:55.508514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508280+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:55.508280+0000","last_peered":"2023-07-29T16:37:55.508280+0000","last_clean":"2023-07-29T16:37:55.508280+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:55.508280+0000","last_undegraded":"2023-07-29T16:37:55.508280+0000","last_fullsized":"2023-07-29T16:37:55.508280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508269+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:55.508269+0000","last_peered":"2023-07-29T16:37:55.508269+0000","last_clean":"2023-07-29T16:37:55.508269+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:55.508269+0000","last_undegraded":"2023-07-29T16:37:55.508269+0000","last_fullsized":"2023-07-29T16:37:55.508269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508467+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:55.508467+0000","last_peered":"2023-07-29T16:37:55.508467+0000","last_clean":"2023-07-29T16:37:55.508467+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:55.508467+0000","last_undegraded":"2023-07-29T16:37:55.508467+0000","last_fullsized":"2023-07-29T16:37:55.508467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945297+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.945297+0000","last_peered":"2023-07-29T16:37:53.945297+0000","last_clean":"2023-07-29T16:37:53.945297+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.945297+0000","last_undegraded":"2023-07-29T16:37:53.945297+0000","last_fullsized":"2023-07-29T16:37:53.945297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508319+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:55.508319+0000","last_peered":"2023-07-29T16:37:55.508319+0000","last_clean":"2023-07-29T16:37:55.508319+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:55.508319+0000","last_undegraded":"2023-07-29T16:37:55.508319+0000","last_fullsized":"2023-07-29T16:37:55.508319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944622+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.944622+0000","last_peered":"2023-07-29T16:37:53.944622+0000","last_clean":"2023-07-29T16:37:53.944622+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.944622+0000","last_undegraded":"2023-07-29T16:37:53.944622+0000","last_fullsized":"2023-07-29T16:37:53.944622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508502+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:55.508502+0000","last_peered":"2023-07-29T16:37:55.508502+0000","last_clean":"2023-07-29T16:37:55.508502+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:55.508502+0000","last_undegraded":"2023-07-29T16:37:55.508502+0000","last_fullsized":"2023-07-29T16:37:55.508502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508220+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:55.508220+0000","last_peered":"2023-07-29T16:37:55.508220+0000","last_clean":"2023-07-29T16:37:55.508220+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:55.508220+0000","last_undegraded":"2023-07-29T16:37:55.508220+0000","last_fullsized":"2023-07-29T16:37:55.508220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508140+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:55.508140+0000","last_peered":"2023-07-29T16:37:55.508140+0000","last_clean":"2023-07-29T16:37:55.508140+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:55.508140+0000","last_undegraded":"2023-07-29T16:37:55.508140+0000","last_fullsized":"2023-07-29T16:37:55.508140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508306+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:55.508306+0000","last_peered":"2023-07-29T16:37:55.508306+0000","last_clean":"2023-07-29T16:37:55.508306+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:55.508306+0000","last_undegraded":"2023-07-29T16:37:55.508306+0000","last_fullsized":"2023-07-29T16:37:55.508306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508449+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:55.508449+0000","last_peered":"2023-07-29T16:37:55.508449+0000","last_clean":"2023-07-29T16:37:55.508449+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:55.508449+0000","last_undegraded":"2023-07-29T16:37:55.508449+0000","last_fullsized":"2023-07-29T16:37:55.508449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946469+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.946469+0000","last_peered":"2023-07-29T16:37:53.946469+0000","last_clean":"2023-07-29T16:37:53.946469+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.946469+0000","last_undegraded":"2023-07-29T16:37:53.946469+0000","last_fullsized":"2023-07-29T16:37:53.946469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508098+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:55.508098+0000","last_peered":"2023-07-29T16:37:55.508098+0000","last_clean":"2023-07-29T16:37:55.508098+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:55.508098+0000","last_undegraded":"2023-07-29T16:37:55.508098+0000","last_fullsized":"2023-07-29T16:37:55.508098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.749476+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:55.749476+0000","last_peered":"2023-07-29T16:37:55.749476+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:55.749476+0000","last_undegraded":"2023-07-29T16:37:55.749476+0000","last_fullsized":"2023-07-29T16:37:55.749476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508408+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:55.508408+0000","last_peered":"2023-07-29T16:37:55.508408+0000","last_clean":"2023-07-29T16:37:55.508408+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:55.508408+0000","last_undegraded":"2023-07-29T16:37:55.508408+0000","last_fullsized":"2023-07-29T16:37:55.508408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508481+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:55.508481+0000","last_peered":"2023-07-29T16:37:55.508481+0000","last_clean":"2023-07-29T16:37:55.508481+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:55.508481+0000","last_undegraded":"2023-07-29T16:37:55.508481+0000","last_fullsized":"2023-07-29T16:37:55.508481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508162+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:55.508162+0000","last_peered":"2023-07-29T16:37:55.508162+0000","last_clean":"2023-07-29T16:37:55.508162+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:55.508162+0000","last_undegraded":"2023-07-29T16:37:55.508162+0000","last_fullsized":"2023-07-29T16:37:55.508162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508293+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:55.508293+0000","last_peered":"2023-07-29T16:37:55.508293+0000","last_clean":"2023-07-29T16:37:55.508293+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:55.508293+0000","last_undegraded":"2023-07-29T16:37:55.508293+0000","last_fullsized":"2023-07-29T16:37:55.508293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:03.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:03.590 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:03.591 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:03.602 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-29T16:38:03.456123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81488,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034032,"statfs":{"total":289910292480,"available":289826848768,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.513516"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508425+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:55.508425+0000","last_peered":"2023-07-29T16:37:55.508425+0000","last_clean":"2023-07-29T16:37:55.508425+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:55.508425+0000","last_undegraded":"2023-07-29T16:37:55.508425+0000","last_fullsized":"2023-07-29T16:37:55.508425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508436+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:55.508436+0000","last_peered":"2023-07-29T16:37:55.508436+0000","last_clean":"2023-07-29T16:37:55.508436+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:55.508436+0000","last_undegraded":"2023-07-29T16:37:55.508436+0000","last_fullsized":"2023-07-29T16:37:55.508436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508340+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:55.508340+0000","last_peered":"2023-07-29T16:37:55.508340+0000","last_clean":"2023-07-29T16:37:55.508340+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:55.508340+0000","last_undegraded":"2023-07-29T16:37:55.508340+0000","last_fullsized":"2023-07-29T16:37:55.508340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508183+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:55.508183+0000","last_peered":"2023-07-29T16:37:55.508183+0000","last_clean":"2023-07-29T16:37:55.508183+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:55.508183+0000","last_undegraded":"2023-07-29T16:37:55.508183+0000","last_fullsized":"2023-07-29T16:37:55.508183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508351+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:55.508351+0000","last_peered":"2023-07-29T16:37:55.508351+0000","last_clean":"2023-07-29T16:37:55.508351+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:55.508351+0000","last_undegraded":"2023-07-29T16:37:55.508351+0000","last_fullsized":"2023-07-29T16:37:55.508351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508197+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:55.508197+0000","last_peered":"2023-07-29T16:37:55.508197+0000","last_clean":"2023-07-29T16:37:55.508197+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:55.508197+0000","last_undegraded":"2023-07-29T16:37:55.508197+0000","last_fullsized":"2023-07-29T16:37:55.508197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508382+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:55.508382+0000","last_peered":"2023-07-29T16:37:55.508382+0000","last_clean":"2023-07-29T16:37:55.508382+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:55.508382+0000","last_undegraded":"2023-07-29T16:37:55.508382+0000","last_fullsized":"2023-07-29T16:37:55.508382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508119+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:55.508119+0000","last_peered":"2023-07-29T16:37:55.508119+0000","last_clean":"2023-07-29T16:37:55.508119+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:55.508119+0000","last_undegraded":"2023-07-29T16:37:55.508119+0000","last_fullsized":"2023-07-29T16:37:55.508119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508492+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:55.508492+0000","last_peered":"2023-07-29T16:37:55.508492+0000","last_clean":"2023-07-29T16:37:55.508492+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:55.508492+0000","last_undegraded":"2023-07-29T16:37:55.508492+0000","last_fullsized":"2023-07-29T16:37:55.508492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508129+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:55.508129+0000","last_peered":"2023-07-29T16:37:55.508129+0000","last_clean":"2023-07-29T16:37:55.508129+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:55.508129+0000","last_undegraded":"2023-07-29T16:37:55.508129+0000","last_fullsized":"2023-07-29T16:37:55.508129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508207+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:55.508207+0000","last_peered":"2023-07-29T16:37:55.508207+0000","last_clean":"2023-07-29T16:37:55.508207+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:55.508207+0000","last_undegraded":"2023-07-29T16:37:55.508207+0000","last_fullsized":"2023-07-29T16:37:55.508207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508233+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:55.508233+0000","last_peered":"2023-07-29T16:37:55.508233+0000","last_clean":"2023-07-29T16:37:55.508233+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:55.508233+0000","last_undegraded":"2023-07-29T16:37:55.508233+0000","last_fullsized":"2023-07-29T16:37:55.508233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508248+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:55.508248+0000","last_peered":"2023-07-29T16:37:55.508248+0000","last_clean":"2023-07-29T16:37:55.508248+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:55.508248+0000","last_undegraded":"2023-07-29T16:37:55.508248+0000","last_fullsized":"2023-07-29T16:37:55.508248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508394+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:55.508394+0000","last_peered":"2023-07-29T16:37:55.508394+0000","last_clean":"2023-07-29T16:37:55.508394+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:55.508394+0000","last_undegraded":"2023-07-29T16:37:55.508394+0000","last_fullsized":"2023-07-29T16:37:55.508394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508514+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:55.508514+0000","last_peered":"2023-07-29T16:37:55.508514+0000","last_clean":"2023-07-29T16:37:55.508514+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:55.508514+0000","last_undegraded":"2023-07-29T16:37:55.508514+0000","last_fullsized":"2023-07-29T16:37:55.508514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508280+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:55.508280+0000","last_peered":"2023-07-29T16:37:55.508280+0000","last_clean":"2023-07-29T16:37:55.508280+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:55.508280+0000","last_undegraded":"2023-07-29T16:37:55.508280+0000","last_fullsized":"2023-07-29T16:37:55.508280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508269+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:55.508269+0000","last_peered":"2023-07-29T16:37:55.508269+0000","last_clean":"2023-07-29T16:37:55.508269+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:55.508269+0000","last_undegraded":"2023-07-29T16:37:55.508269+0000","last_fullsized":"2023-07-29T16:37:55.508269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508467+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:55.508467+0000","last_peered":"2023-07-29T16:37:55.508467+0000","last_clean":"2023-07-29T16:37:55.508467+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:55.508467+0000","last_undegraded":"2023-07-29T16:37:55.508467+0000","last_fullsized":"2023-07-29T16:37:55.508467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945297+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.945297+0000","last_peered":"2023-07-29T16:37:53.945297+0000","last_clean":"2023-07-29T16:37:53.945297+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.945297+0000","last_undegraded":"2023-07-29T16:37:53.945297+0000","last_fullsized":"2023-07-29T16:37:53.945297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508319+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:55.508319+0000","last_peered":"2023-07-29T16:37:55.508319+0000","last_clean":"2023-07-29T16:37:55.508319+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:55.508319+0000","last_undegraded":"2023-07-29T16:37:55.508319+0000","last_fullsized":"2023-07-29T16:37:55.508319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944622+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.944622+0000","last_peered":"2023-07-29T16:37:53.944622+0000","last_clean":"2023-07-29T16:37:53.944622+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.944622+0000","last_undegraded":"2023-07-29T16:37:53.944622+0000","last_fullsized":"2023-07-29T16:37:53.944622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508502+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:55.508502+0000","last_peered":"2023-07-29T16:37:55.508502+0000","last_clean":"2023-07-29T16:37:55.508502+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:55.508502+0000","last_undegraded":"2023-07-29T16:37:55.508502+0000","last_fullsized":"2023-07-29T16:37:55.508502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508220+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:55.508220+0000","last_peered":"2023-07-29T16:37:55.508220+0000","last_clean":"2023-07-29T16:37:55.508220+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:55.508220+0000","last_undegraded":"2023-07-29T16:37:55.508220+0000","last_fullsized":"2023-07-29T16:37:55.508220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508140+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:55.508140+0000","last_peered":"2023-07-29T16:37:55.508140+0000","last_clean":"2023-07-29T16:37:55.508140+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:55.508140+0000","last_undegraded":"2023-07-29T16:37:55.508140+0000","last_fullsized":"2023-07-29T16:37:55.508140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508306+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:55.508306+0000","last_peered":"2023-07-29T16:37:55.508306+0000","last_clean":"2023-07-29T16:37:55.508306+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:55.508306+0000","last_undegraded":"2023-07-29T16:37:55.508306+0000","last_fullsized":"2023-07-29T16:37:55.508306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508449+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:55.508449+0000","last_peered":"2023-07-29T16:37:55.508449+0000","last_clean":"2023-07-29T16:37:55.508449+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:55.508449+0000","last_undegraded":"2023-07-29T16:37:55.508449+0000","last_fullsized":"2023-07-29T16:37:55.508449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946469+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.946469+0000","last_peered":"2023-07-29T16:37:53.946469+0000","last_clean":"2023-07-29T16:37:53.946469+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.946469+0000","last_undegraded":"2023-07-29T16:37:53.946469+0000","last_fullsized":"2023-07-29T16:37:53.946469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508098+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:55.508098+0000","last_peered":"2023-07-29T16:37:55.508098+0000","last_clean":"2023-07-29T16:37:55.508098+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:55.508098+0000","last_undegraded":"2023-07-29T16:37:55.508098+0000","last_fullsized":"2023-07-29T16:37:55.508098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.749476+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:55.749476+0000","last_peered":"2023-07-29T16:37:55.749476+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:55.749476+0000","last_undegraded":"2023-07-29T16:37:55.749476+0000","last_fullsized":"2023-07-29T16:37:55.749476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508408+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:55.508408+0000","last_peered":"2023-07-29T16:37:55.508408+0000","last_clean":"2023-07-29T16:37:55.508408+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:55.508408+0000","last_undegraded":"2023-07-29T16:37:55.508408+0000","last_fullsized":"2023-07-29T16:37:55.508408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508481+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:55.508481+0000","last_peered":"2023-07-29T16:37:55.508481+0000","last_clean":"2023-07-29T16:37:55.508481+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:55.508481+0000","last_undegraded":"2023-07-29T16:37:55.508481+0000","last_fullsized":"2023-07-29T16:37:55.508481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508162+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:55.508162+0000","last_peered":"2023-07-29T16:37:55.508162+0000","last_clean":"2023-07-29T16:37:55.508162+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:55.508162+0000","last_undegraded":"2023-07-29T16:37:55.508162+0000","last_fullsized":"2023-07-29T16:37:55.508162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508293+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:55.508293+0000","last_peered":"2023-07-29T16:37:55.508293+0000","last_clean":"2023-07-29T16:37:55.508293+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:55.508293+0000","last_undegraded":"2023-07-29T16:37:55.508293+0000","last_fullsized":"2023-07-29T16:37:55.508293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:03.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T16:38:03.608 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-29T16:38:03.609 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-29T16:38:03.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-29T16:38:04.001 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:04.001 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-29T16:38:04.015 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-29T16:38:04.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:38:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:04.334 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:38:04.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T16:38:04.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T16:38:04.665 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-07-29T16:38:04.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T16:38:04.998 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 8 2023-07-29T16:38:05.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T16:38:05.330 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-07-29T16:38:05.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T16:38:05.663 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-07-29T16:38:05.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T16:38:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:06.036 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T16:37:53.941272+0000","modified":"2023-07-29T16:37:56.950204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6803/4082681389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4082681389},{"type":"v1","addr":"172.21.15.70:6803","nonce":4082681389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T16:38:06.038 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2023-07-29T16:38:06.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:38:06.366 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:06.366 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:38:06.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T16:38:06.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T16:38:06.696 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-07-29T16:38:06.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T16:38:07.029 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 8 2023-07-29T16:38:07.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T16:38:07.362 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-07-29T16:38:07.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T16:38:07.695 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-07-29T16:38:07.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T16:38:08.071 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:08.071 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T16:37:53.941272+0000","modified":"2023-07-29T16:37:56.950204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6803/4082681389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4082681389},{"type":"v1","addr":"172.21.15.70:6803","nonce":4082681389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T16:38:08.073 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2023-07-29T16:38:08.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:38:08.403 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:08.404 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"c7d00049-842a-4a32-8de6-3e4b9423aea7","created":"2023-07-29T16:37:31.745128+0000","modified":"2023-07-29T16:37:54.942521+0000","last_up_change":"2023-07-29T16:37:40.281964+0000","last_in_change":"2023-07-29T16:37:32.650908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-29T16:37:41.494530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-29T16:37:47.008107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T16:37:51.635875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T16:37:52.915940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b382307-786b-44f2-86db-ca9158b22127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":94564},{"type":"v1","addr":"172.21.15.98:6801","nonce":94564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":94564},{"type":"v1","addr":"172.21.15.98:6803","nonce":94564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":94564},{"type":"v1","addr":"172.21.15.98:6807","nonce":94564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":94564},{"type":"v1","addr":"172.21.15.98:6805","nonce":94564}]},"public_addr":"172.21.15.98:6801/94564","cluster_addr":"172.21.15.98:6803/94564","heartbeat_back_addr":"172.21.15.98:6807/94564","heartbeat_front_addr":"172.21.15.98:6805/94564","state":["exists","up"]},{"osd":1,"uuid":"f63dfc0a-a0cd-41f1-84c7-3a2da78625a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":94556},{"type":"v1","addr":"172.21.15.102:6801","nonce":94556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":94556},{"type":"v1","addr":"172.21.15.102:6803","nonce":94556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":94556},{"type":"v1","addr":"172.21.15.102:6807","nonce":94556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":94556},{"type":"v1","addr":"172.21.15.102:6805","nonce":94556}]},"public_addr":"172.21.15.102:6801/94556","cluster_addr":"172.21.15.102:6803/94556","heartbeat_back_addr":"172.21.15.102:6807/94556","heartbeat_front_addr":"172.21.15.102:6805/94556","state":["exists","up"]},{"osd":2,"uuid":"659e5b83-bc39-4700-81b4-3cf949380228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":94718},{"type":"v1","addr":"172.21.15.151:6801","nonce":94718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":94718},{"type":"v1","addr":"172.21.15.151:6803","nonce":94718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":94718},{"type":"v1","addr":"172.21.15.151:6807","nonce":94718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":94718},{"type":"v1","addr":"172.21.15.151:6805","nonce":94718}]},"public_addr":"172.21.15.151:6801/94718","cluster_addr":"172.21.15.151:6803/94718","heartbeat_back_addr":"172.21.15.151:6807/94718","heartbeat_front_addr":"172.21.15.151:6805/94718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.748180+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.698202+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T16:37:37.720882+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T16:38:08.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T16:38:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:08.778 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T16:37:53.941272+0000","modified":"2023-07-29T16:37:56.950204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6803/4082681389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4082681389},{"type":"v1","addr":"172.21.15.70:6803","nonce":4082681389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T16:38:08.781 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2023-07-29T16:38:08.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-29T16:37:53.941272+0000', 'modified': '2023-07-29T16:37:56.950204+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4201': {'gid': 4201, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.70:6803/4082681389', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 4082681389}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 4082681389}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-29T16:38:08.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-29T16:38:08.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-29T16:38:09.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-29T16:38:09.029+0000 7fc3177fe700 0 client.4475 ms_handle_reset on v2:172.21.15.70:6802/4082681389 2023-07-29T16:38:09.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-07-29T16:38:09.050+0000 7fc3177fe700 0 client.4481 ms_handle_reset on v2:172.21.15.70:6802/4082681389 2023-07-29T16:38:09.052 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4201, 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-07-29T16:38:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 15.107939887000001, 2023-07-29T16:38:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 6, 2023-07-29T16:38:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 18, 2023-07-29T16:38:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 18, 2023-07-29T16:38:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 20.412174140000001 2023-07-29T16:38:09.055 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:09.064 INFO:teuthology.run_tasks:Running task thrashosds... 2023-07-29T16:38:09.077 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-07-29T16:38:09.078 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}} 2023-07-29T16:38:09.079 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-07-29T16:38:09.079 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-07-29T16:38:09.080 DEBUG:teuthology.orchestra.run.smithi070:> sync 2023-07-29T16:38:09.221 DEBUG:teuthology.orchestra.run.smithi098:> sync 2023-07-29T16:38:09.287 DEBUG:teuthology.orchestra.run.smithi102:> sync 2023-07-29T16:38:09.388 DEBUG:teuthology.orchestra.run.smithi151:> sync 2023-07-29T16:38:09.559 DEBUG:tasks.thrashosds:checking console status of smithi070 2023-07-29T16:38:09.560 DEBUG:teuthology.orchestra.console.smithi070:Waiting for login prompt 2023-07-29T16:38:09.561 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi070 2023-07-29T16:38:09.704 DEBUG:teuthology.orchestra.console.smithi070:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T16:38:09.705 DEBUG:teuthology.orchestra.console.smithi070:expect after: smithi070 login: 2023-07-29T16:38:09.756 DEBUG:teuthology.orchestra.console.smithi070:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi070 login: [disconnect] 2023-07-29T16:38:09.858 DEBUG:tasks.thrashosds:checking console status of smithi098 2023-07-29T16:38:09.858 DEBUG:teuthology.orchestra.console.smithi098:Waiting for login prompt 2023-07-29T16:38:09.858 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi098 2023-07-29T16:38:09.957 DEBUG:teuthology.orchestra.console.smithi098:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T16:38:09.958 DEBUG:teuthology.orchestra.console.smithi098:expect after: smithi098 login: 2023-07-29T16:38:10.009 DEBUG:teuthology.orchestra.console.smithi098:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi098 login: [disconnect] 2023-07-29T16:38:10.111 DEBUG:tasks.thrashosds:checking console status of smithi102 2023-07-29T16:38:10.111 DEBUG:teuthology.orchestra.console.smithi102:Waiting for login prompt 2023-07-29T16:38:10.112 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi102 2023-07-29T16:38:10.224 DEBUG:teuthology.orchestra.console.smithi102:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T16:38:10.225 DEBUG:teuthology.orchestra.console.smithi102:expect after: smithi102 login: 2023-07-29T16:38:10.277 DEBUG:teuthology.orchestra.console.smithi102:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi102 login: [disconnect] 2023-07-29T16:38:10.379 DEBUG:tasks.thrashosds:checking console status of smithi151 2023-07-29T16:38:10.379 DEBUG:teuthology.orchestra.console.smithi151:Waiting for login prompt 2023-07-29T16:38:10.380 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi151 2023-07-29T16:38:10.494 DEBUG:teuthology.orchestra.console.smithi151:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-07-29T16:38:10.494 DEBUG:teuthology.orchestra.console.smithi151:expect after: smithi151 login: 2023-07-29T16:38:10.546 DEBUG:teuthology.orchestra.console.smithi151:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi151 login: [disconnect] 2023-07-29T16:38:10.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-07-29T16:38:10.997 INFO:tasks.thrashosds:Beginning thrashosds... 2023-07-29T16:38:10.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T16:38:10.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:11.320 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:11.330 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-29T16:38:09.457272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81488,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034032,"statfs":{"total":289910292480,"available":289826848768,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002375"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508425+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:55.508425+0000","last_peered":"2023-07-29T16:37:55.508425+0000","last_clean":"2023-07-29T16:37:55.508425+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:55.508425+0000","last_undegraded":"2023-07-29T16:37:55.508425+0000","last_fullsized":"2023-07-29T16:37:55.508425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508436+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:55.508436+0000","last_peered":"2023-07-29T16:37:55.508436+0000","last_clean":"2023-07-29T16:37:55.508436+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:55.508436+0000","last_undegraded":"2023-07-29T16:37:55.508436+0000","last_fullsized":"2023-07-29T16:37:55.508436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508340+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:55.508340+0000","last_peered":"2023-07-29T16:37:55.508340+0000","last_clean":"2023-07-29T16:37:55.508340+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:55.508340+0000","last_undegraded":"2023-07-29T16:37:55.508340+0000","last_fullsized":"2023-07-29T16:37:55.508340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508183+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:55.508183+0000","last_peered":"2023-07-29T16:37:55.508183+0000","last_clean":"2023-07-29T16:37:55.508183+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:55.508183+0000","last_undegraded":"2023-07-29T16:37:55.508183+0000","last_fullsized":"2023-07-29T16:37:55.508183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508351+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:55.508351+0000","last_peered":"2023-07-29T16:37:55.508351+0000","last_clean":"2023-07-29T16:37:55.508351+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:55.508351+0000","last_undegraded":"2023-07-29T16:37:55.508351+0000","last_fullsized":"2023-07-29T16:37:55.508351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508197+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:55.508197+0000","last_peered":"2023-07-29T16:37:55.508197+0000","last_clean":"2023-07-29T16:37:55.508197+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:55.508197+0000","last_undegraded":"2023-07-29T16:37:55.508197+0000","last_fullsized":"2023-07-29T16:37:55.508197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508382+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:55.508382+0000","last_peered":"2023-07-29T16:37:55.508382+0000","last_clean":"2023-07-29T16:37:55.508382+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:55.508382+0000","last_undegraded":"2023-07-29T16:37:55.508382+0000","last_fullsized":"2023-07-29T16:37:55.508382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508119+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:55.508119+0000","last_peered":"2023-07-29T16:37:55.508119+0000","last_clean":"2023-07-29T16:37:55.508119+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:55.508119+0000","last_undegraded":"2023-07-29T16:37:55.508119+0000","last_fullsized":"2023-07-29T16:37:55.508119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508492+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:55.508492+0000","last_peered":"2023-07-29T16:37:55.508492+0000","last_clean":"2023-07-29T16:37:55.508492+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:55.508492+0000","last_undegraded":"2023-07-29T16:37:55.508492+0000","last_fullsized":"2023-07-29T16:37:55.508492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508129+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:55.508129+0000","last_peered":"2023-07-29T16:37:55.508129+0000","last_clean":"2023-07-29T16:37:55.508129+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:55.508129+0000","last_undegraded":"2023-07-29T16:37:55.508129+0000","last_fullsized":"2023-07-29T16:37:55.508129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508207+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:55.508207+0000","last_peered":"2023-07-29T16:37:55.508207+0000","last_clean":"2023-07-29T16:37:55.508207+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:55.508207+0000","last_undegraded":"2023-07-29T16:37:55.508207+0000","last_fullsized":"2023-07-29T16:37:55.508207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508233+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:55.508233+0000","last_peered":"2023-07-29T16:37:55.508233+0000","last_clean":"2023-07-29T16:37:55.508233+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:55.508233+0000","last_undegraded":"2023-07-29T16:37:55.508233+0000","last_fullsized":"2023-07-29T16:37:55.508233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508248+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:55.508248+0000","last_peered":"2023-07-29T16:37:55.508248+0000","last_clean":"2023-07-29T16:37:55.508248+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:55.508248+0000","last_undegraded":"2023-07-29T16:37:55.508248+0000","last_fullsized":"2023-07-29T16:37:55.508248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508394+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:55.508394+0000","last_peered":"2023-07-29T16:37:55.508394+0000","last_clean":"2023-07-29T16:37:55.508394+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:55.508394+0000","last_undegraded":"2023-07-29T16:37:55.508394+0000","last_fullsized":"2023-07-29T16:37:55.508394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508514+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:55.508514+0000","last_peered":"2023-07-29T16:37:55.508514+0000","last_clean":"2023-07-29T16:37:55.508514+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:55.508514+0000","last_undegraded":"2023-07-29T16:37:55.508514+0000","last_fullsized":"2023-07-29T16:37:55.508514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508280+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:55.508280+0000","last_peered":"2023-07-29T16:37:55.508280+0000","last_clean":"2023-07-29T16:37:55.508280+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:55.508280+0000","last_undegraded":"2023-07-29T16:37:55.508280+0000","last_fullsized":"2023-07-29T16:37:55.508280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508269+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:55.508269+0000","last_peered":"2023-07-29T16:37:55.508269+0000","last_clean":"2023-07-29T16:37:55.508269+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:55.508269+0000","last_undegraded":"2023-07-29T16:37:55.508269+0000","last_fullsized":"2023-07-29T16:37:55.508269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508467+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:55.508467+0000","last_peered":"2023-07-29T16:37:55.508467+0000","last_clean":"2023-07-29T16:37:55.508467+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:55.508467+0000","last_undegraded":"2023-07-29T16:37:55.508467+0000","last_fullsized":"2023-07-29T16:37:55.508467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945297+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.945297+0000","last_peered":"2023-07-29T16:37:53.945297+0000","last_clean":"2023-07-29T16:37:53.945297+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.945297+0000","last_undegraded":"2023-07-29T16:37:53.945297+0000","last_fullsized":"2023-07-29T16:37:53.945297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508319+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:55.508319+0000","last_peered":"2023-07-29T16:37:55.508319+0000","last_clean":"2023-07-29T16:37:55.508319+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:55.508319+0000","last_undegraded":"2023-07-29T16:37:55.508319+0000","last_fullsized":"2023-07-29T16:37:55.508319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944622+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.944622+0000","last_peered":"2023-07-29T16:37:53.944622+0000","last_clean":"2023-07-29T16:37:53.944622+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.944622+0000","last_undegraded":"2023-07-29T16:37:53.944622+0000","last_fullsized":"2023-07-29T16:37:53.944622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508502+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:55.508502+0000","last_peered":"2023-07-29T16:37:55.508502+0000","last_clean":"2023-07-29T16:37:55.508502+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:55.508502+0000","last_undegraded":"2023-07-29T16:37:55.508502+0000","last_fullsized":"2023-07-29T16:37:55.508502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508220+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:55.508220+0000","last_peered":"2023-07-29T16:37:55.508220+0000","last_clean":"2023-07-29T16:37:55.508220+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:55.508220+0000","last_undegraded":"2023-07-29T16:37:55.508220+0000","last_fullsized":"2023-07-29T16:37:55.508220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508140+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:55.508140+0000","last_peered":"2023-07-29T16:37:55.508140+0000","last_clean":"2023-07-29T16:37:55.508140+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:55.508140+0000","last_undegraded":"2023-07-29T16:37:55.508140+0000","last_fullsized":"2023-07-29T16:37:55.508140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508306+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:55.508306+0000","last_peered":"2023-07-29T16:37:55.508306+0000","last_clean":"2023-07-29T16:37:55.508306+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:55.508306+0000","last_undegraded":"2023-07-29T16:37:55.508306+0000","last_fullsized":"2023-07-29T16:37:55.508306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508449+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:55.508449+0000","last_peered":"2023-07-29T16:37:55.508449+0000","last_clean":"2023-07-29T16:37:55.508449+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:55.508449+0000","last_undegraded":"2023-07-29T16:37:55.508449+0000","last_fullsized":"2023-07-29T16:37:55.508449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946469+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.946469+0000","last_peered":"2023-07-29T16:37:53.946469+0000","last_clean":"2023-07-29T16:37:53.946469+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.946469+0000","last_undegraded":"2023-07-29T16:37:53.946469+0000","last_fullsized":"2023-07-29T16:37:53.946469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508098+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:55.508098+0000","last_peered":"2023-07-29T16:37:55.508098+0000","last_clean":"2023-07-29T16:37:55.508098+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:55.508098+0000","last_undegraded":"2023-07-29T16:37:55.508098+0000","last_fullsized":"2023-07-29T16:37:55.508098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.749476+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:55.749476+0000","last_peered":"2023-07-29T16:37:55.749476+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:55.749476+0000","last_undegraded":"2023-07-29T16:37:55.749476+0000","last_fullsized":"2023-07-29T16:37:55.749476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508408+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:55.508408+0000","last_peered":"2023-07-29T16:37:55.508408+0000","last_clean":"2023-07-29T16:37:55.508408+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:55.508408+0000","last_undegraded":"2023-07-29T16:37:55.508408+0000","last_fullsized":"2023-07-29T16:37:55.508408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508481+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:55.508481+0000","last_peered":"2023-07-29T16:37:55.508481+0000","last_clean":"2023-07-29T16:37:55.508481+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:55.508481+0000","last_undegraded":"2023-07-29T16:37:55.508481+0000","last_fullsized":"2023-07-29T16:37:55.508481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508162+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:55.508162+0000","last_peered":"2023-07-29T16:37:55.508162+0000","last_clean":"2023-07-29T16:37:55.508162+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:55.508162+0000","last_undegraded":"2023-07-29T16:37:55.508162+0000","last_fullsized":"2023-07-29T16:37:55.508162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508293+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:55.508293+0000","last_peered":"2023-07-29T16:37:55.508293+0000","last_clean":"2023-07-29T16:37:55.508293+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:55.508293+0000","last_undegraded":"2023-07-29T16:37:55.508293+0000","last_fullsized":"2023-07-29T16:37:55.508293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:11.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:11.710 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-29T16:38:11.457681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81488,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034032,"statfs":{"total":289910292480,"available":289826848768,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508425+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:55.508425+0000","last_peered":"2023-07-29T16:37:55.508425+0000","last_clean":"2023-07-29T16:37:55.508425+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:55.508425+0000","last_undegraded":"2023-07-29T16:37:55.508425+0000","last_fullsized":"2023-07-29T16:37:55.508425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508436+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:55.508436+0000","last_peered":"2023-07-29T16:37:55.508436+0000","last_clean":"2023-07-29T16:37:55.508436+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:55.508436+0000","last_undegraded":"2023-07-29T16:37:55.508436+0000","last_fullsized":"2023-07-29T16:37:55.508436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508340+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:55.508340+0000","last_peered":"2023-07-29T16:37:55.508340+0000","last_clean":"2023-07-29T16:37:55.508340+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:55.508340+0000","last_undegraded":"2023-07-29T16:37:55.508340+0000","last_fullsized":"2023-07-29T16:37:55.508340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508183+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:55.508183+0000","last_peered":"2023-07-29T16:37:55.508183+0000","last_clean":"2023-07-29T16:37:55.508183+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:55.508183+0000","last_undegraded":"2023-07-29T16:37:55.508183+0000","last_fullsized":"2023-07-29T16:37:55.508183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508351+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:55.508351+0000","last_peered":"2023-07-29T16:37:55.508351+0000","last_clean":"2023-07-29T16:37:55.508351+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:55.508351+0000","last_undegraded":"2023-07-29T16:37:55.508351+0000","last_fullsized":"2023-07-29T16:37:55.508351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508197+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:55.508197+0000","last_peered":"2023-07-29T16:37:55.508197+0000","last_clean":"2023-07-29T16:37:55.508197+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:55.508197+0000","last_undegraded":"2023-07-29T16:37:55.508197+0000","last_fullsized":"2023-07-29T16:37:55.508197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508382+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:55.508382+0000","last_peered":"2023-07-29T16:37:55.508382+0000","last_clean":"2023-07-29T16:37:55.508382+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:55.508382+0000","last_undegraded":"2023-07-29T16:37:55.508382+0000","last_fullsized":"2023-07-29T16:37:55.508382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508119+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:55.508119+0000","last_peered":"2023-07-29T16:37:55.508119+0000","last_clean":"2023-07-29T16:37:55.508119+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:55.508119+0000","last_undegraded":"2023-07-29T16:37:55.508119+0000","last_fullsized":"2023-07-29T16:37:55.508119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508492+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:55.508492+0000","last_peered":"2023-07-29T16:37:55.508492+0000","last_clean":"2023-07-29T16:37:55.508492+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:55.508492+0000","last_undegraded":"2023-07-29T16:37:55.508492+0000","last_fullsized":"2023-07-29T16:37:55.508492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508129+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:55.508129+0000","last_peered":"2023-07-29T16:37:55.508129+0000","last_clean":"2023-07-29T16:37:55.508129+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:55.508129+0000","last_undegraded":"2023-07-29T16:37:55.508129+0000","last_fullsized":"2023-07-29T16:37:55.508129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508207+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:55.508207+0000","last_peered":"2023-07-29T16:37:55.508207+0000","last_clean":"2023-07-29T16:37:55.508207+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:55.508207+0000","last_undegraded":"2023-07-29T16:37:55.508207+0000","last_fullsized":"2023-07-29T16:37:55.508207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508233+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:55.508233+0000","last_peered":"2023-07-29T16:37:55.508233+0000","last_clean":"2023-07-29T16:37:55.508233+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:55.508233+0000","last_undegraded":"2023-07-29T16:37:55.508233+0000","last_fullsized":"2023-07-29T16:37:55.508233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508248+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:55.508248+0000","last_peered":"2023-07-29T16:37:55.508248+0000","last_clean":"2023-07-29T16:37:55.508248+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:55.508248+0000","last_undegraded":"2023-07-29T16:37:55.508248+0000","last_fullsized":"2023-07-29T16:37:55.508248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508394+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:55.508394+0000","last_peered":"2023-07-29T16:37:55.508394+0000","last_clean":"2023-07-29T16:37:55.508394+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:55.508394+0000","last_undegraded":"2023-07-29T16:37:55.508394+0000","last_fullsized":"2023-07-29T16:37:55.508394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508514+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:55.508514+0000","last_peered":"2023-07-29T16:37:55.508514+0000","last_clean":"2023-07-29T16:37:55.508514+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:55.508514+0000","last_undegraded":"2023-07-29T16:37:55.508514+0000","last_fullsized":"2023-07-29T16:37:55.508514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508280+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:55.508280+0000","last_peered":"2023-07-29T16:37:55.508280+0000","last_clean":"2023-07-29T16:37:55.508280+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:55.508280+0000","last_undegraded":"2023-07-29T16:37:55.508280+0000","last_fullsized":"2023-07-29T16:37:55.508280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508269+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:55.508269+0000","last_peered":"2023-07-29T16:37:55.508269+0000","last_clean":"2023-07-29T16:37:55.508269+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:55.508269+0000","last_undegraded":"2023-07-29T16:37:55.508269+0000","last_fullsized":"2023-07-29T16:37:55.508269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508467+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:55.508467+0000","last_peered":"2023-07-29T16:37:55.508467+0000","last_clean":"2023-07-29T16:37:55.508467+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:55.508467+0000","last_undegraded":"2023-07-29T16:37:55.508467+0000","last_fullsized":"2023-07-29T16:37:55.508467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945297+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.945297+0000","last_peered":"2023-07-29T16:37:53.945297+0000","last_clean":"2023-07-29T16:37:53.945297+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.945297+0000","last_undegraded":"2023-07-29T16:37:53.945297+0000","last_fullsized":"2023-07-29T16:37:53.945297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508319+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:55.508319+0000","last_peered":"2023-07-29T16:37:55.508319+0000","last_clean":"2023-07-29T16:37:55.508319+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:55.508319+0000","last_undegraded":"2023-07-29T16:37:55.508319+0000","last_fullsized":"2023-07-29T16:37:55.508319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944622+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.944622+0000","last_peered":"2023-07-29T16:37:53.944622+0000","last_clean":"2023-07-29T16:37:53.944622+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.944622+0000","last_undegraded":"2023-07-29T16:37:53.944622+0000","last_fullsized":"2023-07-29T16:37:53.944622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508502+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:55.508502+0000","last_peered":"2023-07-29T16:37:55.508502+0000","last_clean":"2023-07-29T16:37:55.508502+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:55.508502+0000","last_undegraded":"2023-07-29T16:37:55.508502+0000","last_fullsized":"2023-07-29T16:37:55.508502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508220+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:55.508220+0000","last_peered":"2023-07-29T16:37:55.508220+0000","last_clean":"2023-07-29T16:37:55.508220+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:55.508220+0000","last_undegraded":"2023-07-29T16:37:55.508220+0000","last_fullsized":"2023-07-29T16:37:55.508220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508140+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:55.508140+0000","last_peered":"2023-07-29T16:37:55.508140+0000","last_clean":"2023-07-29T16:37:55.508140+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:55.508140+0000","last_undegraded":"2023-07-29T16:37:55.508140+0000","last_fullsized":"2023-07-29T16:37:55.508140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508306+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:55.508306+0000","last_peered":"2023-07-29T16:37:55.508306+0000","last_clean":"2023-07-29T16:37:55.508306+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:55.508306+0000","last_undegraded":"2023-07-29T16:37:55.508306+0000","last_fullsized":"2023-07-29T16:37:55.508306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508449+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:55.508449+0000","last_peered":"2023-07-29T16:37:55.508449+0000","last_clean":"2023-07-29T16:37:55.508449+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:55.508449+0000","last_undegraded":"2023-07-29T16:37:55.508449+0000","last_fullsized":"2023-07-29T16:37:55.508449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946469+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.946469+0000","last_peered":"2023-07-29T16:37:53.946469+0000","last_clean":"2023-07-29T16:37:53.946469+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.946469+0000","last_undegraded":"2023-07-29T16:37:53.946469+0000","last_fullsized":"2023-07-29T16:37:53.946469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508098+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:55.508098+0000","last_peered":"2023-07-29T16:37:55.508098+0000","last_clean":"2023-07-29T16:37:55.508098+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:55.508098+0000","last_undegraded":"2023-07-29T16:37:55.508098+0000","last_fullsized":"2023-07-29T16:37:55.508098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.749476+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:55.749476+0000","last_peered":"2023-07-29T16:37:55.749476+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:55.749476+0000","last_undegraded":"2023-07-29T16:37:55.749476+0000","last_fullsized":"2023-07-29T16:37:55.749476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508408+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:55.508408+0000","last_peered":"2023-07-29T16:37:55.508408+0000","last_clean":"2023-07-29T16:37:55.508408+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:55.508408+0000","last_undegraded":"2023-07-29T16:37:55.508408+0000","last_fullsized":"2023-07-29T16:37:55.508408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508481+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:55.508481+0000","last_peered":"2023-07-29T16:37:55.508481+0000","last_clean":"2023-07-29T16:37:55.508481+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:55.508481+0000","last_undegraded":"2023-07-29T16:37:55.508481+0000","last_fullsized":"2023-07-29T16:37:55.508481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508162+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:55.508162+0000","last_peered":"2023-07-29T16:37:55.508162+0000","last_clean":"2023-07-29T16:37:55.508162+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:55.508162+0000","last_undegraded":"2023-07-29T16:37:55.508162+0000","last_fullsized":"2023-07-29T16:37:55.508162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508293+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:55.508293+0000","last_peered":"2023-07-29T16:37:55.508293+0000","last_clean":"2023-07-29T16:37:55.508293+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:55.508293+0000","last_undegraded":"2023-07-29T16:37:55.508293+0000","last_fullsized":"2023-07-29T16:37:55.508293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:11.716 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T16:38:11.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-07-29T16:38:12.070 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 18 2023-07-29T16:38:12.071 INFO:teuthology.orchestra.run.smithi070.stdout:fsid c7d00049-842a-4a32-8de6-3e4b9423aea7 2023-07-29T16:38:12.071 INFO:teuthology.orchestra.run.smithi070.stdout:created 2023-07-29T16:37:31.745128+0000 2023-07-29T16:38:12.071 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2023-07-29T16:37:54.942521+0000 2023-07-29T16:38:12.071 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-07-29T16:38:12.071 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 4 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client jewel 2023-07-29T16:38:12.072 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release reef 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-07-29T16:38:12.073 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 3 2023-07-29T16:38:12.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/94564,v1:172.21.15.98:6801/94564] [v2:172.21.15.98:6802/94564,v1:172.21.15.98:6803/94564] exists,up 8b382307-786b-44f2-86db-ca9158b22127 2023-07-29T16:38:12.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/94556,v1:172.21.15.102:6801/94556] [v2:172.21.15.102:6802/94556,v1:172.21.15.102:6803/94556] exists,up f63dfc0a-a0cd-41f1-84c7-3a2da78625a4 2023-07-29T16:38:12.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/94718,v1:172.21.15.151:6801/94718] [v2:172.21.15.151:6802/94718,v1:172.21.15.151:6803/94718] exists,up 659e5b83-bc39-4700-81b4-3cf949380228 2023-07-29T16:38:12.084 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/94564,v1:172.21.15.98:6801/94564] [v2:172.21.15.98:6802/94564,v1:172.21.15.98:6803/94564] exists,up 8b382307-786b-44f2-86db-ca9158b22127', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/94556,v1:172.21.15.102:6801/94556] [v2:172.21.15.102:6802/94556,v1:172.21.15.102:6803/94556] exists,up f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/94718,v1:172.21.15.151:6801/94718] [v2:172.21.15.151:6802/94718,v1:172.21.15.151:6803/94718] exists,up 659e5b83-bc39-4700-81b4-3cf949380228'] 2023-07-29T16:38:12.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-07-29T16:38:12.206 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mon.a", 2023-07-29T16:38:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster": "ceph", 2023-07-29T16:38:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-07-29T16:38:12.207 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket_mode": "", 2023-07-29T16:38:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-07-29T16:38:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_client_required": "cephx, none", 2023-07-29T16:38:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_cluster_required": "cephx", 2023-07-29T16:38:12.208 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_debug": "true", 2023-07-29T16:38:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-07-29T16:38:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-07-29T16:38:12.209 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_required": "cephx", 2023-07-29T16:38:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_ticket_ttl": "240.000000", 2023-07-29T16:38:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_supported": "cephx", 2023-07-29T16:38:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio": "true", 2023-07-29T16:38:12.210 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_max_queue_depth": "1024", 2023-07-29T16:38:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_poll_ms": "250", 2023-07-29T16:38:12.211 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_reap_max": "16", 2023-07-29T16:38:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_async_discard": "false", 2023-07-29T16:38:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_block_size": "4096", 2023-07-29T16:38:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio": "false", 2023-07-29T16:38:12.212 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-07-29T16:38:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-07-29T16:38:12.213 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_inflight_ios": "false", 2023-07-29T16:38:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_enable_discard": "false", 2023-07-29T16:38:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry": "3", 2023-07-29T16:38:12.214 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry_interval": "0.100000", 2023-07-29T16:38:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash": "0", 2023-07-29T16:38:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash_flush_delay": "2", 2023-07-29T16:38:12.215 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring": "false", 2023-07-29T16:38:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_hipri": "false", 2023-07-29T16:38:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_sqthread_poll": "false", 2023-07-29T16:38:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-07-29T16:38:12.216 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_buffer_alignment": "4096", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_type": "", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_alloc_size": "1048576", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_allocator": "hybrid", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_buffered_io": "true", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_for_zeros": "false", 2023-07-29T16:38:12.217 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_often": "false", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_compact_log_sync": "false", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_size": "16777216", 2023-07-29T16:38:12.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_replay_check_allocations": "true", 2023-07-29T16:38:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_log_runway": "4194304", 2023-07-29T16:38:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_prefetch": "1048576", 2023-07-29T16:38:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_flush_size": "524288", 2023-07-29T16:38:12.219 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_log_runway": "1048576", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery": "false", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_shared_alloc_size": "65536", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_sync_write": "false", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-07-29T16:38:12.220 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocation_from_file": "true", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocator": "hybrid", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-07-29T16:38:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blobid_prealloc": "10240", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_create": "true", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_create": "false", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_path": "", 2023-07-29T16:38:12.222 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_size": "0", 2023-07-29T16:38:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_path": "", 2023-07-29T16:38:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_preallocate_file": "false", 2023-07-29T16:38:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_size": "107374182400", 2023-07-29T16:38:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_create": "false", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_path": "", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_size": "100663296", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs": "true", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_env_mirror": "false", 2023-07-29T16:38:12.224 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune": "true", 2023-07-29T16:38:12.225 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size": "0", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-07-29T16:38:12.226 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_type": "2q", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_clone_cow": "true", 2023-07-29T16:38:12.227 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_algorithm": "snappy", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size": "0", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size": "0", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-07-29T16:38:12.228 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_mode": "none", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_csum_type": "crc32c", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_settings": "default", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_freelist": "false", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_fsck_abort": "false", 2023-07-29T16:38:12.229 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_bug21040": "false", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_read_err": "false", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_legacy_omap": "false", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-07-29T16:38:12.230 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefill": "0.000000", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_small_allocations": "0", 2023-07-29T16:38:12.231 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_read": "true", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_write": "false", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops": "0", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-07-29T16:38:12.232 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fail_eio": "false", 2023-07-29T16:38:12.233 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-07-29T16:38:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-07-29T16:38:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-07-29T16:38:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-07-29T16:38:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs": "true", 2023-07-29T16:38:12.234 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-07-29T16:38:12.235 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-07-29T16:38:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-07-29T16:38:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-07-29T16:38:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-07-29T16:38:12.236 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_ignore_data_csum": "false", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kvbackend": "rocksdb", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_op_age": "5.000000", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_alloc_size": "0", 2023-07-29T16:38:12.237 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size": "0", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_defer_interval": "3.000000", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_deferred_txc": "32", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size": "0", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-07-29T16:38:12.238 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_nid_prealloc": "1024", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size": "0", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_qfsck_on_mount": "true", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_retry_disk_reads": "3", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cf": "true", 2023-07-29T16:38:12.239 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-07-29T16:38:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-07-29T16:38:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options_annex": "", 2023-07-29T16:38:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_coremask": "0x1", 2023-07-29T16:38:12.240 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_io_sleep": "5", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_max_io_completion": "0", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_mem": "512", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_sync_submit_transaction": "false", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_bytes": "67108864", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io": "0", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-07-29T16:38:12.241 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_tracing": "false", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved": "0", 2023-07-29T16:38:12.242 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-07-29T16:38:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-07-29T16:38:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-07-29T16:38:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-07-29T16:38:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-07-29T16:38:12.243 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-07-29T16:38:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_zero_block_detection": "false", 2023-07-29T16:38:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-07-29T16:38:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_action_update_interval": "2", 2023-07-29T16:38:12.244 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-07-29T16:38:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-07-29T16:38:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-07-29T16:38:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-07-29T16:38:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_mount_timeout": "10", 2023-07-29T16:38:12.245 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-07-29T16:38:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-07-29T16:38:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-07-29T16:38:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-07-29T16:38:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-07-29T16:38:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-07-29T16:38:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_signatures": "false", 2023-07-29T16:38:12.247 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_version": "2", 2023-07-29T16:38:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_signatures": "false", 2023-07-29T16:38:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_version": "2", 2023-07-29T16:38:12.248 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_signatures": "false", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_version": "2", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_sign_messages": "true", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "chdir": "", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_acl_type": "", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_asio_thread_count": "2", 2023-07-29T16:38:12.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_mid": "0.750000", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_size": "16384", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_caps_release_delay": "5", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_check_pool_perm": "true", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_collect_and_send_global_metrics": "false", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_force_sync_read": "false", 2023-07-29T16:38:12.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_getattr_caps": "false", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_tick_delay": "0", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_remount": "false", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_dirsize_rbytes": "true", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_force_lazyio": "false", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_fs": "", 2023-07-29T16:38:12.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_fixed_oldest_tid": "false", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_release_failure": "false", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_inline_size": "4096", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_retries_on_remount_failure": "5", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mds_namespace": "", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_metadata": "", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_gid": "-1", 2023-07-29T16:38:12.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_timeout": "300", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_uid": "-1", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mountpoint": "/", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_notify_timeout": "10", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc": "true", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty": "104857600", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty_age": "5.000000", 2023-07-29T16:38:12.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_objects": "1000", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_size": "209715200", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_target_dirty": "8388608", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_permissions": "true", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota": "true", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota_df": "true", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_bytes": "0", 2023-07-29T16:38:12.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_periods": "4", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_min": "131072", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_reconnect_stale": "false", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_shutdown_timeout": "30", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_snapdir": ".snap", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_tick_interval": "1", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_trace": "", 2023-07-29T16:38:12.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_try_dentry_invalidate": "false", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_faked_inos": "false", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_random_mds": "false", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog": "false", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_port": "12201", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_monitors": "default=true", 2023-07-29T16:38:12.256 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog": "false", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_level": "info", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "-", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network": "", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network_interface": "", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_isal": "false", 2023-07-29T16:38:12.257 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_level": "5", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_winsize": "-15", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zstd_level": "1", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_op_num_threads": "6", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_thread_cpu_cores": "", 2023-07-29T16:38:12.258 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_obc_lru_size": "10", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_smp": "1", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location": "", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook": "", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook_timeout": "10", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "daemonize": "false", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "daos_pool": "tank", 2023-07-29T16:38:12.259 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_name_prefix": "dbstore", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_alienstore": "0/5", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_allow_any_pool_priority": "false", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok": "1/5", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok_assert_abort": "false", 2023-07-29T16:38:12.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asserts_on_shutdown": "true", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_auth": "20/20", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bdev": "1/3", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluefs": "1/5", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluestore": "1/5", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_buffer": "0/1", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_exporter": "1/5", 2023-07-29T16:38:12.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephfs_mirror": "0/5", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephsqlite": "0/5", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_client": "0/5", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_compressor": "1/5", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_context": "0/1", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crush": "1/1", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crypto": "1/5", 2023-07-29T16:38:12.262 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cyanstore": "0/5", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_deliberately_leak_memory": "false", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_disable_randomized_ping": "false", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_dpdk": "1/5", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_eventtrace": "1/5", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filer": "0/1", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filestore": "1/3", 2023-07-29T16:38:12.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_finisher": "1/1", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_fuse": "1/5", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeat_testing_span": "0", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeatmap": "1/5", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_immutable_obj_cache": "0/5", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_javaclient": "1/5", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journal": "1/3", 2023-07-29T16:38:12.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journaler": "0/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_kstore": "1/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_leveldb": "4/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_lockdep": "0/1", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mclock": "1/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds": "1/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_balancer": "1/5", 2023-07-29T16:38:12.265 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_locker": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log_expire": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_migrator": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_memstore": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgr": "2/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgrc": "1/5", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mon": "20/20", 2023-07-29T16:38:12.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_monc": "0/10", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ms": "1/1", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_none": "0/5", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objclass": "0/5", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objectcacher": "0/5", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objecter": "0/1", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_optracker": "0/5", 2023-07-29T16:38:12.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_osd": "1/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_paxos": "20/20", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_perfcounter": "1/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_prioritycache": "1/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rados": "0/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd": "0/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_mirror": "0/5", 2023-07-29T16:38:12.268 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_pwl": "0/5", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_replay": "0/5", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_refs": "0/0", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_reserver": "1/1", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw": "1/5", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_access": "1/5", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_datacache": "1/5", 2023-07-29T16:38:12.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_dbstore": "1/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_flight": "1/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_sync": "1/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rocksdb": "4/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore": "0/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_backref": "0/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cache": "0/5", 2023-07-29T16:38:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cleaner": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_device": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_epm": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_journal": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_lba": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_odata": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_omap": "0/5", 2023-07-29T16:38:12.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_onode": "0/5", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_t": "0/5", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_tm": "0/5", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_striper": "0/1", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_test": "0/5", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_throttle": "1/1", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_timer": "0/1", 2023-07-29T16:38:12.272 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_tp": "0/5", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "device_failure_prediction_mode": "none", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_graylog": "false", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_journald": "false", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_stderr": "true", 2023-07-29T16:38:12.273 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_syslog": "false", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event_tracing": "false", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_addr": "0.0.0.0", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_http_port": "9926", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_prio_limit": "5", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sort_metrics": "true", 2023-07-29T16:38:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_stats_period": "5", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "fake_statfs_for_testing": "0", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "fatal_signal_handlers": "true", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_purge_ops": "10", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_truncate_ops": "128", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_apply_finisher_threads": "1", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_blackhole": "false", 2023-07-29T16:38:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_clone_range": "true", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_snap": "true", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_caller_concurrency": "10", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_collect_device_partition_information": "true", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_commit_timeout": "600.000000", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_inject_read_err": "false", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_omap_check": "false", 2023-07-29T16:38:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_random_read_err": "0.000000", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_verify_split": "false", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_dump_file": "", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fadvise": "true", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fail_eio": "true", 2023-07-29T16:38:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_shards": "16", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_size": "128", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap": "false", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap_threshold": "4096", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_index_retry_probability": "0.000000", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_inject_stall": "0", 2023-07-29T16:38:12.278 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_parallel": "false", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_trailing": "false", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_writeahead": "false", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_kill_at": "0", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size": "0", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-07-29T16:38:12.279 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs": "0", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_other": "2", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_sync_interval": "5.000000", 2023-07-29T16:38:12.280 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size": "0", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_merge_threshold": "-10", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_min_sync_interval": "0.010000", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_odsync_write": "false", 2023-07-29T16:38:12.281 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend": "rocksdb", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend_path": "", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_header_cache_size": "1024", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_ondisk_finisher_threads": "1", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_timeout": "60", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_threads": "2", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_punch_hole": "false", 2023-07-29T16:38:12.282 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_bytes": "104857600", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-07-29T16:38:12.283 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_ops": "50", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_seek_data_hole": "false", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc": "false", 2023-07-29T16:38:12.284 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_splice": "false", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_multiple": "2", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_rand_factor": "20", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_update_to": "1000", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-07-29T16:38:12.285 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_enable": "true", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-07-29T16:38:12.286 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_xfs_extsize": "false", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_zfs_snap": "false", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "fio_dir": "/tmp/fio", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_allow_other": "true", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_atomic_o_trunc": "true", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_big_writes": "true", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_debug": "false", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_default_permissions": "false", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_disable_pagecache": "false", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_max_write": "0", 2023-07-29T16:38:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_multithreaded": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_require_active_mds": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_set_user_groups": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_move": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_read": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_write": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_syncfs_on_mksnap": "true", 2023-07-29T16:38:12.289 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_use_invalidate_cb": "true", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_target_name": "ceph", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_file": "", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_inject_failure": "0", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_interval": "5", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "host": "smithi070", 2023-07-29T16:38:12.290 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_size": "1073741824", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-07-29T16:38:12.291 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_watermark": "0.900000", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "inject_early_sigterm": "false", 2023-07-29T16:38:12.292 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_agent_port": "6799", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_tracing_enable": "false", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_aio": "true", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_align_min_size": "65536", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_align": "true", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_size": "4096", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_dio": "true", 2023-07-29T16:38:12.293 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_discard": "false", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_force_aio": "false", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_ignore_corruption": "false", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_bytes": "10485760", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_entries": "100", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_replay_from": "0", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_multiple": "0.000000", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-07-29T16:38:12.294 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_max_multiple": "0.000000", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_write_header_frequency": "0", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_zero_on_create": "false", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prefetch_periods": "10", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prezero_periods": "5", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_write_head_interval": "15", 2023-07-29T16:38:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "keyfile": "", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_backend": "rocksdb", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_default_stripe_size": "65536", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount": "false", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount_deep": "true", 2023-07-29T16:38:12.296 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_bytes": "67108864", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_ops": "512", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_nid_prealloc": "1024", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_onode_map_size": "1024", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_submit_transaction": "false", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_transaction": "false", 2023-07-29T16:38:12.297 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_block_size": "65536", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_bloom_size": "0", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_cache_size": "536870912", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_compact_on_mount": "false", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_compression": "false", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_log": "", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_log_to_ceph_log": "true", 2023-07-29T16:38:12.298 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_max_open_files": "0", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_paranoid": "false", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "leveldb_write_buffer_size": "33554432", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "librados_thread_count": "2", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep": "false", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep_force_backtrace": "false", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "log_coarse_timestamps": "true", 2023-07-29T16:38:12.299 INFO:teuthology.orchestra.run.smithi070.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_flush_on_exit": "false", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_host": "127.0.0.1", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_port": "12201", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_new": "1000", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_recent": "10000", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stderr_prefix": "", 2023-07-29T16:38:12.300 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stop_at_utilization": "0.970000", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": "true", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_graylog": "false", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_journald": "false", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_stderr": "false", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_syslog": "false", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_rotating_auth_attempts": "10", 2023-07-29T16:38:12.301 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_action_on_write_error": "1", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_alternate_name_max": "8192", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_asio_thread_count": "2", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_export_pin": "true", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_dirs": "true", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_interval": "5", 2023-07-29T16:38:12.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_size_max": "100000", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_idle_threshold": "0.000000", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_interval": "10", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max": "-1", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max_until": "-1", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_merge_size": "50", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_midchunk": "0.300000", 2023-07-29T16:38:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_rebalance": "0.100000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_start": "0.200000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_minchunk": "0.001000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_mode": "0", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_max": "1.200000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_min": "0.800000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-07-29T16:38:12.304 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_sample_interval": "3.000000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_bits": "3", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_rd": "25000.000000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_size": "10000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_wr": "10000.000000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_target_decay": "10.000000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-07-29T16:38:12.305 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_grace": "15.000000", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_interval": "4.000000", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_mon_down_grace": "60", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_memory_limit": "4294967296", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_mid": "0.700000", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_release_free_interval": "10", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_reservation": "0.050000", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-07-29T16:38:12.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_interval": "1", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_threshold": "262144", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_delegate_inos_pct": "50", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_prealloc_inos": "1000", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-07-29T16:38:12.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_connect_bootstrapping": "false", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_damage_table_max_entries": "10000", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_auth_pins": "false", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_frag": "false", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_scatterstat": "false", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_subtrees": "false", 2023-07-29T16:38:12.308 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_decay_halflife": "5.000000", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_default_dir_hash": "2", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_defer_session_stale": "true", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_deny_all_reconnect": "false", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_keys_per_op": "16384", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_commit_size": "10", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_entries": "0", 2023-07-29T16:38:12.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_prefetch": "true", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dirstat_min_interval": "1.000000", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_after_rejoin": "false", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_on_map": "false", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_file": "0", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_early_reply": "true", 2023-07-29T16:38:12.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enable_op_tracker": "true", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enforce_unique_name": "true", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed": "true", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random": "true", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_forward_all_requests_to_auth": "false", 2023-07-29T16:38:12.311 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_cache_threshold": "1.500000", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_summarize_threshold": "10", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_grace": "15.000000", 2023-07-29T16:38:12.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_reset_grace": "1000", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_health_dummy": "false", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_migrator_session_race": "false", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-07-29T16:38:12.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_join_fs": "", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_journal_format": "1", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_create_at": "0", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_export_at": "0", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_import_at": "0", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_at": "0", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_expire_at": "0", 2023-07-29T16:38:12.314 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_replay_at": "0", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_link_at": "0", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_mdstable_at": "0", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_openc_at": "0", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_rename_at": "0", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_events_per_segment": "1024", 2023-07-29T16:38:12.315 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_events": "-1", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_segments": "128", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_pause": "false", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_segment_size": "0", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_corrupt_events": "false", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_warn_factor": "2.000000", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_caps_per_client": "1048576", 2023-07-29T16:38:12.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_flushes": "100000", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_requests": "100000", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_export_size": "20971520", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_file_recover": "32", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_files": "64", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops": "8192", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-07-29T16:38:12.317 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_snaps_per_dir": "100", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_xattr_pairs_size": "65536", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_metrics_update_interval": "2", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_per_client": "100", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_working_set": "10000", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_numa_node": "-1", 2023-07-29T16:38:12.318 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_complaint_time": "30.000000", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_duration": "600", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_size": "20", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_log_threshold": "5", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_grace": "15", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_interval": "5", 2023-07-29T16:38:12.319 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_caps": "30000", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_threshold": "131072", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_threshold": "262144", 2023-07-29T16:38:12.320 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_reconnect_timeout": "45.000000", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_interval": "1.000000", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_gid": "0", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_uid": "0", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-07-29T16:38:12.321 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_evict": "true", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_timeout": "true", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-07-29T16:38:12.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_shutdown_check": "0", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_skip_ino": "0", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sleep_rank_change": "0.000000", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_max_uid": "4294967294", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_min_uid": "0", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_rstat": "false", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_standby_replay_damaged": "false", 2023-07-29T16:38:12.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_symlink_recovery": "true", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_task_status_update_interval": "2.000000", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_exports": "0", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_fragments": "0", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_tick_interval": "5.000000", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_valgrind_exit": "false", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_backtrace": "1", 2023-07-29T16:38:12.324 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_scatter": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_ino_prealloc": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_sessions": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool_debug": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_debug_omit_block_device_write": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_device_bytes": "1073741824", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_set": "false", 2023-07-29T16:38:12.325 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_size": "65536", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_bytes": "134217728", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_messages": "512", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_connect_retry_interval": "1.000000", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-07-29T16:38:12.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_disabled_modules": "", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_num_change": "128", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_bytes": "134217728", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_messages": "128", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_bytes": "134217728", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_messages": "128", 2023-07-29T16:38:12.327 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_bytes": "536870912", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_messages": "8192", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_pool": "true", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_service_beacon_grace": "60.000000", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_standby_modules": "true", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_period": "5", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_threshold": "5", 2023-07-29T16:38:12.328 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_tick_period": "2", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_accept_timeout_factor": "2.000000", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_delete": "true", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_size_one": "true", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_auth_validate_all_caps": "true", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-07-29T16:38:12.329 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_bytes": "104857600", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_directed_command_retry": "2", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval": "3.000000", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-07-29T16:38:12.330 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_parallel": "3", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_log_interval": "1.000000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_interval": "10.000000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_timeout": "30.000000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_allowed": "1.000000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-07-29T16:38:12.331 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file_level": "debug", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_file": "true", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog": "false", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_journald": "false", 2023-07-29T16:38:12.332 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_stderr": "false", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_bootstrap": "false", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_start": "false", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_trim": "true", 2023-07-29T16:38:12.333 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_persist_interval": "10", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_score_halflife": "43200", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_config_key_max_entry_size": "65536", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cpu_threads": "4", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_crush_min_required_version": "hammer", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_daemon_bytes": "419430400", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-07-29T16:38:12.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_crit": "5", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_warn": "5", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_size_warn": "16106127360", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_block_osdmap_trim": "false", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_json": "false", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-07-29T16:38:12.335 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_transactions": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_extra_checks": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_quincy": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_reef": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-07-29T16:38:12.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_delta_reset_interval": "10.000000", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_dns_srv_name": "ceph-mon", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_mkfs_grace": "120", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_default_strategy": "1", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_timeout": "5.000000", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_divisor": "2", 2023-07-29T16:38:12.337 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_timeout": "2.000000", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_enable_op_tracker": "true", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fake_pool_delete": "false", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_force_quorum_join": "false", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_globalid_prealloc": "10000", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_detail_to_clog": "false", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_log_update_period": "5", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_max_detail": "50", 2023-07-29T16:38:12.338 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog": "true", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_interval": "600", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host": "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host_override": "", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_initial_members": "", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-07-29T16:38:12.339 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_keyvaluedb": "rocksdb", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease": "5.000000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-07-29T16:38:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_full_interval": "50", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max": "10000", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max_summary": "50", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_entries_per_event": "4096", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_epochs": "500", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mdsmap_epochs": "500", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mgrmap_epochs": "500", 2023-07-29T16:38:12.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_osd": "10000", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pg_per_osd": "10000", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pool_pg_num": "65536", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_force_trim_to": "0", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_skip_sanity": "false", 2023-07-29T16:38:12.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_autotune": "true", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_target": "2147483648", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_beacon_grace": "30", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_digest_period": "5", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_inactive_grace": "60", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_mkfs_grace": "240", 2023-07-29T16:38:12.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_min_osdmap_epochs": "500", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_complaint_time": "30", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_duration": "600", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_size": "20", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_size": "20", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_threshold": "10", 2023-07-29T16:38:12.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_log_threshold": "5", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_in": "false", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_new_in": "true", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-07-29T16:38:12.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size": "500", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size_min": "134217728", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_crush_smoke_test": "true", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_destroyed_out_interval": "600", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_interval": "600", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-07-29T16:38:12.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_force_trim_to": "0", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_full_ratio": "0.950000", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_halflife": "3600", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_max_interval": "300", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_weight": "0.300000", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-07-29T16:38:12.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_creating_pgs": "1024", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_initial_pgs": "1024", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_down_reporters": "2", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp": "true", 2023-07-29T16:38:12.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_report_timeout": "900", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_num_repaired": "10", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_op_age": "32.000000", 2023-07-29T16:38:12.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_interval": "10", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_min": "10000", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_stuck_threshold": "60", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_objects": "10000", 2023-07-29T16:38:12.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_per_osd": "0", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_crit_threshold": "0", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_warn_threshold": "0", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_probe_timeout": "2.000000", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_change": "0.050000", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_osds": "4", 2023-07-29T16:38:12.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_interval": "86400", 2023-07-29T16:38:12.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_max_keys": "100", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_timeout": "300", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_session_timeout": "300", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_smart_report_timeout": "5", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stat_smooth_intervals": "6", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_min_size": "2", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_size": "4", 2023-07-29T16:38:12.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_subscribe_interval": "86400.000000", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_debug": "false", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_keys": "2000", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_size": "1048576", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_provider_kill_at": "0", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_requester_kill_at": "0", 2023-07-29T16:38:12.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_timeout": "60.000000", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_target_pg_per_osd": "100", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_tick_interval": "5", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_interval": "300.000000", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_use_min_delay_socket": "false", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_older_version_delay": "604800", 2023-07-29T16:38:12.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_filestore_osds": "false", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-07-29T16:38:12.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_misplaced": "false", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_older_version": "true", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_app": "true", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-07-29T16:38:12.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_too_few_osds": "false", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "monmap": "", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-07-29T16:38:12.358 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_tracing_enabled": "false", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_op_threads": "3", 2023-07-29T16:38:12.359 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_buffer_size": "131072", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_cm": "false", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_device_name": "", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_dscp": "96", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_gid_idx": "0", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_local_gid": "", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_polling_us": "1000", 2023-07-29T16:38:12.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_port_num": "1", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_roce_ver": "1", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_send_buffers": "1024", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_sl": "3", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_support_srq": "true", 2023-07-29T16:38:12.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_type": "ib", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_reap_threshold": "5", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_before_connect": "false", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv4": "true", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv6": "false", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr1": "true", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr2": "true", 2023-07-29T16:38:12.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_max": "7568", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_min": "6800", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_prefer_ipv4": "false", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_count": "3", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_delay": "5", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_client": "false", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mds": "false", 2023-07-29T16:38:12.363 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mgr": "false", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mon": "false", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_osd": "false", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_mode": "crc secure", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_mode": "crc secure", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_type": "", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_compress_secure": "false", 2023-07-29T16:38:12.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_idle_timeout": "900", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_ready_timeout": "10", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_data": "true", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_header": "true", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bad_msg": "false", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bug": "true", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_old_message": "true", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_skipped_message": "false", 2023-07-29T16:38:12.365 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_unhandled_msg": "false", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_coremask": "0xF", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_devs_allowlist": "", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_enable_tso": "true", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-07-29T16:38:12.366 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hugepages": "", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_flow_control": "true", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_lro": "true", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_memory_channel": "4", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-07-29T16:38:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_pmd": "", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_port_id": "0", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_corrupt_message_level": "1", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_on_send": "false", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_initial_backoff": "0.200000", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_max": "1.000000", 2023-07-29T16:38:12.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_probability": "0.000000", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_type": "", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_internal_delays": "0.000000", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_network_congestion": "0", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_socket_failures": "0", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_learn_addr_from_peer": "true", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_accept_failures": "4", 2023-07-29T16:38:12.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_backoff": "15.000000", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_client_mode": "secure crc", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_cluster_mode": "secure crc", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_service_mode": "secure crc", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_min_size": "1024", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_mode": "none", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compression_algorithm": "snappy", 2023-07-29T16:38:12.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_min_cost": "65536", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_public_type": "", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_service_mode": "crc secure", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_listen_backlog": "512", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_nodelay": "true", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-07-29T16:38:12.371 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_rcvbuf": "0", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_type": "async+posix", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "no_config_file": "false", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_completion_locks_per_session": "32", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_debug_inject_relock_delay": "false", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_op_bytes": "104857600", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_ops": "1024", 2023-07-29T16:38:12.372 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inject_no_watch_ping": "false", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_tick_interval": "5.000000", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_timeout": "10.000000", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_blackhole": "false", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "openssl_engine_opts": "", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_delay_time": "5.000000", 2023-07-29T16:38:12.373 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_hist_halflife": "1000", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_low_ops": "2", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_ops": "4", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_quantize_effort": "0.100000", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_slop": "0.020000", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_allow_recovery_below_min_size": "true", 2023-07-29T16:38:12.374 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_asio_thread_count": "2", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_async_recovery_min_cost": "100", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_auto_mark_unfound_lost": "false", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_retry_interval": "30.000000", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_max": "512", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_min": "64", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_degraded": "false", 2023-07-29T16:38:12.375 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_peering": "false", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_unfound": "true", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_beacon_report_interval": "300", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_duration": "30", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_max_block_size": "67108864", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_small_size_max_iops": "100", 2023-07-29T16:38:12.376 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blkin_trace_all": "false", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blocked_scrub_grace_period": "120", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_for_log_corruption": "false", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-07-29T16:38:12.377 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_update_on_start": "true", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_cap": "256", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_size_cap": "524288000", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_op_priority": "63", 2023-07-29T16:38:12.378 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_watch_timeout": "30", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_command_max_records": "256", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_compact_on_start": "false", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_chooseleaf_type": "0", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_initial_weight": "-1.000000", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_on_start": "true", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_weight_set": "true", 2023-07-29T16:38:12.379 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_duration": "0", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_feed_pullee": "-1", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-07-29T16:38:12.380 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_misdirected_ops": "false", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_acting_change": "false", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_purge_strays": "false", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_op_order": "false", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pg_log_writeout": "false", 2023-07-29T16:38:12.381 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pretend_recovery_active": "false", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_shutdown": "false", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_cached_snaps": "false", 2023-07-29T16:38:12.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_missing_on_start": "false", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_snaps": "false", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_keys": "1024", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-07-29T16:38:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_stride": "524288", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_data_pool_replay_window": "5", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_notify_timeout": "30", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep": "0.000000", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-07-29T16:38:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_discard_disconnected_ops": "true", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_enable_op_tracker": "true", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_extblkdev_plugins": "vdo", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-07-29T16:38:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_info": "true", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown": "true", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_timeout": "15", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-07-29T16:38:12.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_function_tracing": "false", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_grace": "20", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_interval": "6", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_peers": "10", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_size": "2000", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_stale": "600", 2023-07-29T16:38:12.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_max_size": "100000", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_min_size": "1000", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-07-29T16:38:12.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_flush_on_shutdown": "true", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_size": "5120", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_kill_backfill_at": "0", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_loop_before_reset_tphandle": "64", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_cache_size": "50", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_dedup": "true", 2023-07-29T16:38:12.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max": "40", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max_bytes": "10485760", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_share_max_epochs": "40", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_name_len": "100", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_size": "0", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_backfills": "1", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_count": "5", 2023-07-29T16:38:12.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_period": "600", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_name_len": "2048", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_namespace_len": "256", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_size": "134217728", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_entries_per_request": "1024", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_blocked_by": "16", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_log_entries": "10000", 2023-07-29T16:38:12.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pgls": "1024", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_cost": "8388608", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_objects": "10", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_scrubs": "1", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_trimming_pgs": "2", 2023-07-29T16:38:12.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_op_reply_len": "64", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_size": "90", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-07-29T16:38:12.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_override_recovery_settings": "false", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_profile": "balanced", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-07-29T16:38:12.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-07-29T16:38:12.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_skip_benchmark": "false", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_base": "805306368", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_min": "134217728", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target": "4294967296", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_autotune": "false", 2023-07-29T16:38:12.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_pg_log_entries": "250", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_recovery_priority": "0", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_interval": "30", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_interval": "5", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_max_in_flight": "2", 2023-07-29T16:38:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_cache_shards": "32", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_op_tracker_shard": "32", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_auto_affinity": "true", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_node": "-1", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_prefer_iface": "true", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objecter_finishers": "1", 2023-07-29T16:38:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore": "bluestore", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_fuse": "false", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_tracing": "false", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_complaint_time": "30.000000", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_duration": "600", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_size": "20", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_size": "20", 2023-07-29T16:38:12.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_log_threshold": "5", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards": "0", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_hdd": "5", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_ssd": "8", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard": "0", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-07-29T16:38:12.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_min_cost": "65536", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue": "mclock_scheduler", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue_cut_off": "high", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_suicide_timeout": "150", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_timeout": "15", 2023-07-29T16:38:12.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_open_classes_on_start": "true", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_os_flags": "0", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_peering_op_priority": "255", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_cost": "1048576", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_priority": "5", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_dups_tracked": "3000", 2023-07-29T16:38:12.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_max": "10000", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_min": "100", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_object_context_cache_count": "64", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max": "500", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-07-29T16:38:12.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crimson": "false", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crush_rule": "-1", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_ec_fast_read": "false", 2023-07-29T16:38:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_bulk": "false", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nodelete": "false", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flags": "0", 2023-07-29T16:38:12.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_min_size": "0", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_num": "32", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pgp_num": "0", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_size": "2", 2023-07-29T16:38:12.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_type": "replicated", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_use_gmt_hitset": "true", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_push_per_object_cost": "1000", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_read_ec_check_for_errors": "false", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap": "true", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap_limit": "10", 2023-07-29T16:38:12.407 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_cost": "20971520", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_delay_start": "0.000000", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active": "0", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_hdd": "3", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_ssd": "10", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_chunk": "8388608", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-07-29T16:38:12.408 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_single_start": "1", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_priority": "3", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_warn_multiple": "16", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_priority": "5", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_retry_interval": "30.000000", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep": "0.000000", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-07-29T16:38:12.409 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_repair_during_recovery": "false", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_requested_scrub_priority": "120", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rollback_to_cluster_snap": "", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair": "false", 2023-07-29T16:38:12.410 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_hour": "0", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_week_day": "0", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_max": "25", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_min": "5", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_cost": "52428800", 2023-07-29T16:38:12.411 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_during_recovery": "false", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_hour": "0", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_week_day": "0", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_event_cost": "4096", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_invalid_stats": "true", 2023-07-29T16:38:12.412 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_load_threshold": "0.500000", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_interval": "604800.000000", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_preemptions": "5", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_min_interval": "86400.000000", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_priority": "5", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_reservation_timeout": "5000", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_sleep": "0.000000", 2023-07-29T16:38:12.413 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shutdown_pgref_assert": "false", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_data_digest": "false", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_smart_report_timeout": "5", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_cost": "1048576", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_priority": "5", 2023-07-29T16:38:12.414 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep": "0.000000", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_scrubbing": "15", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-07-29T16:38:12.415 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_transaction_size": "30", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-07-29T16:38:12.416 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_mode": "writeback", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tracing": "false", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_use_stale_snap": "false", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-07-29T16:38:12.417 INFO:teuthology.orchestra.run.smithi070.stdout: "osdc_blkin_trace_all": "false", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_kill_at": "0", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_max_join_drift": "10", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min": "500", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min_wait": "0.050000", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_propose_interval": "1.000000", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max": "500", 2023-07-29T16:38:12.418 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max_multiplier": "20", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_min": "250", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_stash_full_interval": "25", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_max": "500", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_min": "250", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "perf": "true", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-07-29T16:38:12.419 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "-", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrv": "", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "public_bind_addr": "-", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network": "", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network_interface": "", 2023-07-29T16:38:12.420 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_enabled": "false", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_session_max_number": "256", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_mon_op_timeout": "0", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_osd_op_timeout": "0", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_tracing": "false", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_atime_update_interval": "60", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-07-29T16:38:12.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_parent_reads": "false", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_snap_reads": "false", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blkin_trace_all": "false", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_expire_seconds": "0", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_on_break_lock": "true", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache": "true", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_block_writes_upfront": "false", 2023-07-29T16:38:12.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty": "25165824", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_object": "0", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_policy": "writearound", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_size": "33554432", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_target_dirty": "16777216", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_clone_copy_on_read": "false", 2023-07-29T16:38:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_compression_hint": "none", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_concurrent_management_ops": "10", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_clone_format": "auto", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_data_pool": "", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_features": "61", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_format": "2", 2023-07-29T16:38:12.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_map_options": "", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_order": "22", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_pool": "rbd", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_count": "0", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_unit": "0", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_disable_zero_copy_writes": "true", 2023-07-29T16:38:12.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_granularity_bytes": "65536", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_enable_alloc_hint": "true", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler": "simple", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_commit_age": "5.000000", 2023-07-29T16:38:12.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_interval": "0", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-07-29T16:38:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_order": "24", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_pool": "", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_splay_width": "4", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_parent_reads": "false", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_snap_reads": "false", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-07-29T16:38:12.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_type": "simple", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-07-29T16:38:12.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_autotune": "true", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_base": "805306368", 2023-07-29T16:38:12.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_target": "4294967296", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-07-29T16:38:12.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_delete_delay": "0", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_replay_delay": "0", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove": "false", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-07-29T16:38:12.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mtime_update_interval": "60", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_non_blocking_aio": "true", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_thread_timeout": "60", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_threads": "1", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_parent_cache_enabled": "false", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_mode": "disabled", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_path": "/tmp", 2023-07-29T16:38:12.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_size": "1073741824", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_plugins": "", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst": "0", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_limit": "0", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_exclude_ops": "0", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst": "0", 2023-07-29T16:38:12.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_limit": "0", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst": "0", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_limit": "0", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst": "0", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-07-29T16:38:12.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_limit": "0", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_schedule_tick_min": "50", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst": "0", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_limit": "0", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst": "0", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-07-29T16:38:12.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_limit": "0", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_quiesce_notification_attempts": "10", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_read_from_replica_policy": "default", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_max_bytes": "524288", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_trigger_requests": "10", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_request_timed_out_seconds": "30", 2023-07-29T16:38:12.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_skip_partial_discard": "true", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_tracing": "false", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_names": "true", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_pool": "true", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_base_url": "", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_log_level": "", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_acl_grants_max_num": "100", 2023-07-29T16:38:12.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_admin_entry": "admin", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_backend_store": "rados", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_barbican_url": "", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_beast_enable_async": "true", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-07-29T16:38:12.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_max_aio": "128", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_ttl": "600", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_enabled": "true", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_expiry_interval": "900", 2023-07-29T16:38:12.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_lru_size": "10000", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_config_store": "rados", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_content_length_compat": "false", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress": "true", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cors_rules_max_num": "100", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cross_domain_policy": "", 2023-07-29T16:38:12.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_default_encryption_key": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_addr": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_ca_path": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_cert": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_key": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_password": "", 2023-07-29T16:38:12.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_username": "", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_require_ssl": "true", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-07-29T16:38:12.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-07-29T16:38:12.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_suppress_logs": "true", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_addr": "", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_auth": "token", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_namespace": "", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_prefix": "", 2023-07-29T16:38:12.445 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_token_file": "", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_buffersize": "524288", 2023-07-29T16:38:12.446 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_limit": "1024", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_time": "300", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_tcp_keepalive": "0", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-07-29T16:38:12.447 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_fadvise": "4", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_changes_size": "1000", 2023-07-29T16:38:12.448 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_num_shards": "128", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_window": "30", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_notify_interval_msec": "0", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_poll_interval": "20", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_spawn_window": "20", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-07-29T16:38:12.449 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_data_log_backing": "fifo", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_region_info_oid": "default.region", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_defer_to_bucket_acls": "", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-07-29T16:38:12.450 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-07-29T16:38:12.451 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_res": "500.000000", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_name": "", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_s3website_name": "", 2023-07-29T16:38:12.452 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding": "true", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_gc_threads": "true", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_lc_threads": "true", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_ops_log": "false", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_quota_threads": "true", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_static_website": "false", 2023-07-29T16:38:12.453 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_usage_log": "false", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enforce_swift_acls": "true", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_exit_timeout_secs": "120", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_expose_bucket": "false", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_extended_http_attrs": "", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_filter": "none", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontends": "beast port=7480", 2023-07-29T16:38:12.454 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_concurrent_io": "10", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred": "50", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_objs": "32", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_queue_size": "134213632", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_trim_chunk": "16", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_obj_min_wait": "7200", 2023-07-29T16:38:12.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_max_time": "3600", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_period": "3600", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_window_size": "16777216", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_healthcheck_disabling_path": "", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ignore_get_invalid_range": "false", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_init_timeout": "300", 2023-07-29T16:38:12.456 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_domain": "", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password": "", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password_path": "", 2023-07-29T16:38:12.457 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_project": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_tenant": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token_path": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_user": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_api_version": "2", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_domain": "", 2023-07-29T16:38:12.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_password": "", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_project": "", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_tenant": "", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_user": "", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_implicit_tenants": "false", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_enabled": "false", 2023-07-29T16:38:12.459 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_token_cache_size": "10000", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_url": "", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_verify_ssl": "true", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_debug_interval": "-1", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_lock_max_time": "90", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_objs": "32", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_rules": "1000", 2023-07-29T16:38:12.460 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_worker": "3", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_wp_worker": "3", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_thread_delay": "0", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_dnattr": "uid", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchfilter": "", 2023-07-29T16:38:12.461 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_uri": "ldaps://", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_http_headers": "", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_nonexistent_bucket": "false", 2023-07-29T16:38:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name_utc": "false", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_name_len": "0", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_size": "0", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attrs_num_in_req": "0", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_chunk_size": "4194304", 2023-07-29T16:38:12.463 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_concurrent_requests": "1024", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_dynamic_shards": "1999", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_listing_results": "1000", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_notify_retries": "3", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_objs_per_shard": "100000", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_param_size": "1048576", 2023-07-29T16:38:12.464 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_size": "5368709120", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_slo_entries": "1000", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_log_max_shards": "64", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_notify_interval_msec": "200", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_poll_interval": "20", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_spawn_window": "20", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-07-29T16:38:12.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mp_lock_max_time": "600", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_min_part_size": "5242880", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_size": "2017", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-07-29T16:38:12.466 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lanes": "5", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_max_gc": "300", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_gc_threads": "false", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_lc_threads": "false", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_quota_threads": "false", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_sync_thread": "false", 2023-07-29T16:38:12.467 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_async_rados_threads": "32", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_control_oids": "8", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_numa_node": "-1", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_stripe_size": "4194304", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-07-29T16:38:12.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_chunk_size": "100", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_gc_interval": "600", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_hints_num_shards": "127", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_timeout": "600", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_tracing": "false", 2023-07-29T16:38:12.469 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_token": "", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_url": "", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_verify_ssl": "true", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_rados": "false", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_socket_path": "", 2023-07-29T16:38:12.470 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval": "2.000000", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval_max": "30.000000", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_root_pool": ".rgw.root", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-07-29T16:38:12.471 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_continue": "true", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_prohibited_content_length": "false", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_tracing": "false", 2023-07-29T16:38:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm": "", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_id": "", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region": "", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region_root_pool": ".rgw.root", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_region_enforcement": "false", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-07-29T16:38:12.473 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_request_uri": "", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_batch_size": "64", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_max_aio": "128", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_num_logs": "16", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_thread_interval": "600", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_resolve_cname": "false", 2023-07-29T16:38:12.474 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rest_getusage_op_compat": "false", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_run_sync_thread": "true", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_keystone": "false", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_ldap": "false", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_rados": "true", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_sts": "false", 2023-07-29T16:38:12.475 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_success_create_obj_status": "0", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_scheduler_type": "throttler", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_script_uri": "", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_service_provider_name": "", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-07-29T16:38:12.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_id": "", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_secret": "", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_entry": "sts", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_key": "sts", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_max_session_duration": "43200", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_min_session_duration": "900", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_token_introspection_url": "", 2023-07-29T16:38:12.477 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_account_in_url": "false", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_entry": "auth", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_url": "", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_custom_header": "", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_enforce_content_length": "false", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_need_stats": "true", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_tenant_name": "", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_token_expiration": "86400", 2023-07-29T16:38:12.478 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url": "", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url_prefix": "swift", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_versioning_enabled": "false", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_lease_period": "120", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-07-29T16:38:12.479 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_interval": "1200", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_obj_etag_verify": "false", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_history_size": "4096", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-07-29T16:38:12.480 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_thread_pool_size": "512", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_comment": "", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_createby": "", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_encoding": "", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_flag": "false", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_origin": "", 2023-07-29T16:38:12.481 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_sha_unit": "524288", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_tracker": "", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_trust_forwarded_https": "false", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_tick_interval": "30", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_shards": "32", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_user_shards": "1", 2023-07-29T16:38:12.482 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_use_opa_authz": "false", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_size": "-1", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_max_buckets": "1000", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_policies_max_num": "100", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_interval": "86400", 2023-07-29T16:38:12.483 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_unique_email": "true", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_verify_ssl": "true", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_website_routing_rules_max_num": "50", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone": "", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_id": "", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-07-29T16:38:12.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup": "", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_id": "", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_auto_session_clear": "true", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_skip_bucket_step": "false", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_block_size": "4096", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-07-29T16:38:12.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_shard_bits": "4", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_size": "536870912", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_type": "binned_lru", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-07-29T16:38:12.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_compaction_stats": "false", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_extended_stats": "false", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_memory_stats": "false", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_index_type": "binary_search", 2023-07-29T16:38:12.487 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_log_to_ceph_log": "true", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_metadata_block_size": "4096", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_partition_filters": "false", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_perf": "false", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_renewal_timeout": "10", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "run_dir": "/var/run/ceph", 2023-07-29T16:38:12.488 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_block_create": "true", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cache_lru_size": "67108864", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cbjournal_size": "5368709120", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_max_object_size": "16777216", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_device_size": "53687091200", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_capacity": "16", 2023-07-29T16:38:12.489 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_iodepth_limit": "5", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_main_device_type": "SSD", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_concurrent_transactions": "8", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-07-29T16:38:12.490 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_segment_size": "67108864", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "set_keepcaps": "false", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "setgroup": "", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser": "", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser_match_path": "", 2023-07-29T16:38:12.491 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_misplaced_ratio": "0.050000", 2023-07-29T16:38:12.492 INFO:teuthology.orchestra.run.smithi070.stdout: "thp": "false", 2023-07-29T16:38:12.492 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_default_timeout": "60", 2023-07-29T16:38:12.492 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_empty_queue_max_wait": "2", 2023-07-29T16:38:12.492 INFO:teuthology.orchestra.run.smithi070.stdout: "throttler_perf_counter": "true" 2023-07-29T16:38:12.492 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:12.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-07-29T16:38:12.628 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2023-07-29T16:38:12.638 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2023-07-29T16:38:12.647 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2023-07-29T16:38:12.648 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T16:38:12.649 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T16:38:12.649 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-07-29T16:38:12.659 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-07-29T16:38:12.660 INFO:teuthology.run_tasks:Running task radosbench... 2023-07-29T16:38:12.670 INFO:tasks.radosbench:Beginning radosbench... 2023-07-29T16:38:12.671 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2023-07-29T16:38:12.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2023-07-29T16:38:12.672 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-07-29T16:38:12.672 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:12.672 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:12.673 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T16:38:12.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:38:12.673 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-07-29T16:38:12.674 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-07-29T16:38:12.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:12.674 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-07-29T16:38:12.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:12.675 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-07-29T16:38:12.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:38:12.677 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:12.673+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:12.776 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:12.774+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:12.816 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:38:12.816 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:12.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:12.855 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:12.877 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:12.875+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:12.884 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:12.904 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:12.905 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:12.953 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:12.953 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:12.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:12.977 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:12.976+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:13.025 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 18, 2023-07-29T16:38:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:38:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:37:54.942521+0000", 2023-07-29T16:38:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:37:40.281964+0000", 2023-07-29T16:38:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:38:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5799936, 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:38:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:38:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 4, 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:38:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:38:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:38:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:38:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:38:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:38:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:38:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2023-07-29T16:38:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2023-07-29T16:38:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2023-07-29T16:38:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2023-07-29T16:38:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:38:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:38:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:38:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:38:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:38:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:38:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:38:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:38:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:38:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:38:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:38:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:38:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:38:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:38:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 16, 2023-07-29T16:38:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:38:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:38:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:38:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:38:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:38:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 16, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:38:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 16, 2023-07-29T16:38:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:38:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:38:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:38:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:38:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:38:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:38:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:38:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:38:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:38:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:13.145 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.145 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.146 INFO:tasks.thrashosds.thrasher:j is {'epoch': 18, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:37:54.942521+0000', 'last_up_change': '2023-07-29T16:37:40.281964+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:38:13.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:13.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:13.147 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:13.142+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:13.245 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:13.243+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:13.286 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.286 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.296 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:13.346 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:13.345+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:13.423 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.423 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:13.446 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:13.445+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:13.470 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:13.481 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-29T16:38:11.457681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81488,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034032,"statfs":{"total":289910292480,"available":289826848768,"internally_reserved":0,"allocated":647168,"data_stored":1350688,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249204+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:37:55.249204+0000","last_peered":"2023-07-29T16:37:55.249204+0000","last_clean":"2023-07-29T16:37:55.249204+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:37:55.249204+0000","last_undegraded":"2023-07-29T16:37:55.249204+0000","last_fullsized":"2023-07-29T16:37:55.249204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248863+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:37:55.248863+0000","last_peered":"2023-07-29T16:37:55.248863+0000","last_clean":"2023-07-29T16:37:55.248863+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:37:55.248863+0000","last_undegraded":"2023-07-29T16:37:55.248863+0000","last_fullsized":"2023-07-29T16:37:55.248863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949162+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:37:54.949162+0000","last_peered":"2023-07-29T16:37:54.949162+0000","last_clean":"2023-07-29T16:37:54.949162+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:37:54.949162+0000","last_undegraded":"2023-07-29T16:37:54.949162+0000","last_fullsized":"2023-07-29T16:37:54.949162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949206+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:37:54.949206+0000","last_peered":"2023-07-29T16:37:54.949206+0000","last_clean":"2023-07-29T16:37:54.949206+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:37:54.949206+0000","last_undegraded":"2023-07-29T16:37:54.949206+0000","last_fullsized":"2023-07-29T16:37:54.949206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248523+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:37:55.248523+0000","last_peered":"2023-07-29T16:37:55.248523+0000","last_clean":"2023-07-29T16:37:55.248523+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:37:55.248523+0000","last_undegraded":"2023-07-29T16:37:55.248523+0000","last_fullsized":"2023-07-29T16:37:55.248523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948974+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:37:54.948974+0000","last_peered":"2023-07-29T16:37:54.948974+0000","last_clean":"2023-07-29T16:37:54.948974+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:37:54.948974+0000","last_undegraded":"2023-07-29T16:37:54.948974+0000","last_fullsized":"2023-07-29T16:37:54.948974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948696+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:37:54.948696+0000","last_peered":"2023-07-29T16:37:54.948696+0000","last_clean":"2023-07-29T16:37:54.948696+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:37:54.948696+0000","last_undegraded":"2023-07-29T16:37:54.948696+0000","last_fullsized":"2023-07-29T16:37:54.948696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948297+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:37:54.948297+0000","last_peered":"2023-07-29T16:37:54.948297+0000","last_clean":"2023-07-29T16:37:54.948297+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:37:54.948297+0000","last_undegraded":"2023-07-29T16:37:54.948297+0000","last_fullsized":"2023-07-29T16:37:54.948297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508425+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:37:55.508425+0000","last_peered":"2023-07-29T16:37:55.508425+0000","last_clean":"2023-07-29T16:37:55.508425+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:37:55.508425+0000","last_undegraded":"2023-07-29T16:37:55.508425+0000","last_fullsized":"2023-07-29T16:37:55.508425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249193+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:37:55.249193+0000","last_peered":"2023-07-29T16:37:55.249193+0000","last_clean":"2023-07-29T16:37:55.249193+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:37:55.249193+0000","last_undegraded":"2023-07-29T16:37:55.249193+0000","last_fullsized":"2023-07-29T16:37:55.249193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949104+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:37:54.949104+0000","last_peered":"2023-07-29T16:37:54.949104+0000","last_clean":"2023-07-29T16:37:54.949104+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:37:54.949104+0000","last_undegraded":"2023-07-29T16:37:54.949104+0000","last_fullsized":"2023-07-29T16:37:54.949104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248763+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:37:55.248763+0000","last_peered":"2023-07-29T16:37:55.248763+0000","last_clean":"2023-07-29T16:37:55.248763+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:37:55.248763+0000","last_undegraded":"2023-07-29T16:37:55.248763+0000","last_fullsized":"2023-07-29T16:37:55.248763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248725+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:37:55.248725+0000","last_peered":"2023-07-29T16:37:55.248725+0000","last_clean":"2023-07-29T16:37:55.248725+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:37:55.248725+0000","last_undegraded":"2023-07-29T16:37:55.248725+0000","last_fullsized":"2023-07-29T16:37:55.248725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948945+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:37:54.948945+0000","last_peered":"2023-07-29T16:37:54.948945+0000","last_clean":"2023-07-29T16:37:54.948945+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:37:54.948945+0000","last_undegraded":"2023-07-29T16:37:54.948945+0000","last_fullsized":"2023-07-29T16:37:54.948945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948438+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:37:54.948438+0000","last_peered":"2023-07-29T16:37:54.948438+0000","last_clean":"2023-07-29T16:37:54.948438+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:37:54.948438+0000","last_undegraded":"2023-07-29T16:37:54.948438+0000","last_fullsized":"2023-07-29T16:37:54.948438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948780+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:37:54.948780+0000","last_peered":"2023-07-29T16:37:54.948780+0000","last_clean":"2023-07-29T16:37:54.948780+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:37:54.948780+0000","last_undegraded":"2023-07-29T16:37:54.948780+0000","last_fullsized":"2023-07-29T16:37:54.948780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508436+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:37:55.508436+0000","last_peered":"2023-07-29T16:37:55.508436+0000","last_clean":"2023-07-29T16:37:55.508436+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:37:55.508436+0000","last_undegraded":"2023-07-29T16:37:55.508436+0000","last_fullsized":"2023-07-29T16:37:55.508436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249086+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:37:55.249086+0000","last_peered":"2023-07-29T16:37:55.249086+0000","last_clean":"2023-07-29T16:37:55.249086+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:37:55.249086+0000","last_undegraded":"2023-07-29T16:37:55.249086+0000","last_fullsized":"2023-07-29T16:37:55.249086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508340+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:37:55.508340+0000","last_peered":"2023-07-29T16:37:55.508340+0000","last_clean":"2023-07-29T16:37:55.508340+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:37:55.508340+0000","last_undegraded":"2023-07-29T16:37:55.508340+0000","last_fullsized":"2023-07-29T16:37:55.508340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949127+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:37:54.949127+0000","last_peered":"2023-07-29T16:37:54.949127+0000","last_clean":"2023-07-29T16:37:54.949127+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:37:54.949127+0000","last_undegraded":"2023-07-29T16:37:54.949127+0000","last_fullsized":"2023-07-29T16:37:54.949127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:37:54.949243+0000","last_peered":"2023-07-29T16:37:54.949243+0000","last_clean":"2023-07-29T16:37:54.949243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:37:54.949243+0000","last_undegraded":"2023-07-29T16:37:54.949243+0000","last_fullsized":"2023-07-29T16:37:54.949243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248475+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:37:55.248475+0000","last_peered":"2023-07-29T16:37:55.248475+0000","last_clean":"2023-07-29T16:37:55.248475+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:37:55.248475+0000","last_undegraded":"2023-07-29T16:37:55.248475+0000","last_fullsized":"2023-07-29T16:37:55.248475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508183+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:37:55.508183+0000","last_peered":"2023-07-29T16:37:55.508183+0000","last_clean":"2023-07-29T16:37:55.508183+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:37:55.508183+0000","last_undegraded":"2023-07-29T16:37:55.508183+0000","last_fullsized":"2023-07-29T16:37:55.508183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248017+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:37:55.248017+0000","last_peered":"2023-07-29T16:37:55.248017+0000","last_clean":"2023-07-29T16:37:55.248017+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:37:55.248017+0000","last_undegraded":"2023-07-29T16:37:55.248017+0000","last_fullsized":"2023-07-29T16:37:55.248017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249372+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:37:55.249372+0000","last_peered":"2023-07-29T16:37:55.249372+0000","last_clean":"2023-07-29T16:37:55.249372+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:37:55.249372+0000","last_undegraded":"2023-07-29T16:37:55.249372+0000","last_fullsized":"2023-07-29T16:37:55.249372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508351+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:37:55.508351+0000","last_peered":"2023-07-29T16:37:55.508351+0000","last_clean":"2023-07-29T16:37:55.508351+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:37:55.508351+0000","last_undegraded":"2023-07-29T16:37:55.508351+0000","last_fullsized":"2023-07-29T16:37:55.508351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949431+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:37:54.949431+0000","last_peered":"2023-07-29T16:37:54.949431+0000","last_clean":"2023-07-29T16:37:54.949431+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:37:54.949431+0000","last_undegraded":"2023-07-29T16:37:54.949431+0000","last_fullsized":"2023-07-29T16:37:54.949431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248425+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:37:55.248425+0000","last_peered":"2023-07-29T16:37:55.248425+0000","last_clean":"2023-07-29T16:37:55.248425+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:37:55.248425+0000","last_undegraded":"2023-07-29T16:37:55.248425+0000","last_fullsized":"2023-07-29T16:37:55.248425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248829+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:37:55.248829+0000","last_peered":"2023-07-29T16:37:55.248829+0000","last_clean":"2023-07-29T16:37:55.248829+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:37:55.248829+0000","last_undegraded":"2023-07-29T16:37:55.248829+0000","last_fullsized":"2023-07-29T16:37:55.248829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508197+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:37:55.508197+0000","last_peered":"2023-07-29T16:37:55.508197+0000","last_clean":"2023-07-29T16:37:55.508197+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:37:55.508197+0000","last_undegraded":"2023-07-29T16:37:55.508197+0000","last_fullsized":"2023-07-29T16:37:55.508197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508382+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:37:55.508382+0000","last_peered":"2023-07-29T16:37:55.508382+0000","last_clean":"2023-07-29T16:37:55.508382+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:37:55.508382+0000","last_undegraded":"2023-07-29T16:37:55.508382+0000","last_fullsized":"2023-07-29T16:37:55.508382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508119+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:37:55.508119+0000","last_peered":"2023-07-29T16:37:55.508119+0000","last_clean":"2023-07-29T16:37:55.508119+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:37:55.508119+0000","last_undegraded":"2023-07-29T16:37:55.508119+0000","last_fullsized":"2023-07-29T16:37:55.508119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249307+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:37:55.249307+0000","last_peered":"2023-07-29T16:37:55.249307+0000","last_clean":"2023-07-29T16:37:55.249307+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:37:55.249307+0000","last_undegraded":"2023-07-29T16:37:55.249307+0000","last_fullsized":"2023-07-29T16:37:55.249307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508492+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:37:55.508492+0000","last_peered":"2023-07-29T16:37:55.508492+0000","last_clean":"2023-07-29T16:37:55.508492+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:37:55.508492+0000","last_undegraded":"2023-07-29T16:37:55.508492+0000","last_fullsized":"2023-07-29T16:37:55.508492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508129+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:37:55.508129+0000","last_peered":"2023-07-29T16:37:55.508129+0000","last_clean":"2023-07-29T16:37:55.508129+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:37:55.508129+0000","last_undegraded":"2023-07-29T16:37:55.508129+0000","last_fullsized":"2023-07-29T16:37:55.508129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949339+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:37:54.949339+0000","last_peered":"2023-07-29T16:37:54.949339+0000","last_clean":"2023-07-29T16:37:54.949339+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:37:54.949339+0000","last_undegraded":"2023-07-29T16:37:54.949339+0000","last_fullsized":"2023-07-29T16:37:54.949339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508207+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:37:55.508207+0000","last_peered":"2023-07-29T16:37:55.508207+0000","last_clean":"2023-07-29T16:37:55.508207+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:37:55.508207+0000","last_undegraded":"2023-07-29T16:37:55.508207+0000","last_fullsized":"2023-07-29T16:37:55.508207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249026+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:37:55.249026+0000","last_peered":"2023-07-29T16:37:55.249026+0000","last_clean":"2023-07-29T16:37:55.249026+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:37:55.249026+0000","last_undegraded":"2023-07-29T16:37:55.249026+0000","last_fullsized":"2023-07-29T16:37:55.249026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508233+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:37:55.508233+0000","last_peered":"2023-07-29T16:37:55.508233+0000","last_clean":"2023-07-29T16:37:55.508233+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:37:55.508233+0000","last_undegraded":"2023-07-29T16:37:55.508233+0000","last_fullsized":"2023-07-29T16:37:55.508233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949008+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:37:54.949008+0000","last_peered":"2023-07-29T16:37:54.949008+0000","last_clean":"2023-07-29T16:37:54.949008+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:37:54.949008+0000","last_undegraded":"2023-07-29T16:37:54.949008+0000","last_fullsized":"2023-07-29T16:37:54.949008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949105+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:37:54.949105+0000","last_peered":"2023-07-29T16:37:54.949105+0000","last_clean":"2023-07-29T16:37:54.949105+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:37:54.949105+0000","last_undegraded":"2023-07-29T16:37:54.949105+0000","last_fullsized":"2023-07-29T16:37:54.949105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949006+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:37:54.949006+0000","last_peered":"2023-07-29T16:37:54.949006+0000","last_clean":"2023-07-29T16:37:54.949006+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:37:54.949006+0000","last_undegraded":"2023-07-29T16:37:54.949006+0000","last_fullsized":"2023-07-29T16:37:54.949006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248663+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:37:55.248663+0000","last_peered":"2023-07-29T16:37:55.248663+0000","last_clean":"2023-07-29T16:37:55.248663+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:37:55.248663+0000","last_undegraded":"2023-07-29T16:37:55.248663+0000","last_fullsized":"2023-07-29T16:37:55.248663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508248+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:37:55.508248+0000","last_peered":"2023-07-29T16:37:55.508248+0000","last_clean":"2023-07-29T16:37:55.508248+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:37:55.508248+0000","last_undegraded":"2023-07-29T16:37:55.508248+0000","last_fullsized":"2023-07-29T16:37:55.508248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248972+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:37:55.248972+0000","last_peered":"2023-07-29T16:37:55.248972+0000","last_clean":"2023-07-29T16:37:55.248972+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:37:55.248972+0000","last_undegraded":"2023-07-29T16:37:55.248972+0000","last_fullsized":"2023-07-29T16:37:55.248972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248251+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:37:55.248251+0000","last_peered":"2023-07-29T16:37:55.248251+0000","last_clean":"2023-07-29T16:37:55.248251+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:37:55.248251+0000","last_undegraded":"2023-07-29T16:37:55.248251+0000","last_fullsized":"2023-07-29T16:37:55.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508394+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:37:55.508394+0000","last_peered":"2023-07-29T16:37:55.508394+0000","last_clean":"2023-07-29T16:37:55.508394+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:37:55.508394+0000","last_undegraded":"2023-07-29T16:37:55.508394+0000","last_fullsized":"2023-07-29T16:37:55.508394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948462+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:37:54.948462+0000","last_peered":"2023-07-29T16:37:54.948462+0000","last_clean":"2023-07-29T16:37:54.948462+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:37:54.948462+0000","last_undegraded":"2023-07-29T16:37:54.948462+0000","last_fullsized":"2023-07-29T16:37:54.948462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508514+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:37:55.508514+0000","last_peered":"2023-07-29T16:37:55.508514+0000","last_clean":"2023-07-29T16:37:55.508514+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:37:55.508514+0000","last_undegraded":"2023-07-29T16:37:55.508514+0000","last_fullsized":"2023-07-29T16:37:55.508514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949551+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:37:54.949551+0000","last_peered":"2023-07-29T16:37:54.949551+0000","last_clean":"2023-07-29T16:37:54.949551+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:37:54.949551+0000","last_undegraded":"2023-07-29T16:37:54.949551+0000","last_fullsized":"2023-07-29T16:37:54.949551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248632+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:37:55.248632+0000","last_peered":"2023-07-29T16:37:55.248632+0000","last_clean":"2023-07-29T16:37:55.248632+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:37:55.248632+0000","last_undegraded":"2023-07-29T16:37:55.248632+0000","last_fullsized":"2023-07-29T16:37:55.248632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248872+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:37:55.248872+0000","last_peered":"2023-07-29T16:37:55.248872+0000","last_clean":"2023-07-29T16:37:55.248872+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:37:55.248872+0000","last_undegraded":"2023-07-29T16:37:55.248872+0000","last_fullsized":"2023-07-29T16:37:55.248872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248511+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:37:55.248511+0000","last_peered":"2023-07-29T16:37:55.248511+0000","last_clean":"2023-07-29T16:37:55.248511+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:37:55.248511+0000","last_undegraded":"2023-07-29T16:37:55.248511+0000","last_fullsized":"2023-07-29T16:37:55.248511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948925+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:37:54.948925+0000","last_peered":"2023-07-29T16:37:54.948925+0000","last_clean":"2023-07-29T16:37:54.948925+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:37:54.948925+0000","last_undegraded":"2023-07-29T16:37:54.948925+0000","last_fullsized":"2023-07-29T16:37:54.948925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948843+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:37:54.948843+0000","last_peered":"2023-07-29T16:37:54.948843+0000","last_clean":"2023-07-29T16:37:54.948843+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:37:54.948843+0000","last_undegraded":"2023-07-29T16:37:54.948843+0000","last_fullsized":"2023-07-29T16:37:54.948843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948795+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:37:54.948795+0000","last_peered":"2023-07-29T16:37:54.948795+0000","last_clean":"2023-07-29T16:37:54.948795+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:37:54.948795+0000","last_undegraded":"2023-07-29T16:37:54.948795+0000","last_fullsized":"2023-07-29T16:37:54.948795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508280+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:37:55.508280+0000","last_peered":"2023-07-29T16:37:55.508280+0000","last_clean":"2023-07-29T16:37:55.508280+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:37:55.508280+0000","last_undegraded":"2023-07-29T16:37:55.508280+0000","last_fullsized":"2023-07-29T16:37:55.508280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508269+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:37:55.508269+0000","last_peered":"2023-07-29T16:37:55.508269+0000","last_clean":"2023-07-29T16:37:55.508269+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:37:55.508269+0000","last_undegraded":"2023-07-29T16:37:55.508269+0000","last_fullsized":"2023-07-29T16:37:55.508269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948847+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:37:54.948847+0000","last_peered":"2023-07-29T16:37:54.948847+0000","last_clean":"2023-07-29T16:37:54.948847+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:37:54.948847+0000","last_undegraded":"2023-07-29T16:37:54.948847+0000","last_fullsized":"2023-07-29T16:37:54.948847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948523+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:37:54.948523+0000","last_peered":"2023-07-29T16:37:54.948523+0000","last_clean":"2023-07-29T16:37:54.948523+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:37:54.948523+0000","last_undegraded":"2023-07-29T16:37:54.948523+0000","last_fullsized":"2023-07-29T16:37:54.948523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949335+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:37:54.949335+0000","last_peered":"2023-07-29T16:37:54.949335+0000","last_clean":"2023-07-29T16:37:54.949335+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:37:54.949335+0000","last_undegraded":"2023-07-29T16:37:54.949335+0000","last_fullsized":"2023-07-29T16:37:54.949335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248197+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:37:55.248197+0000","last_peered":"2023-07-29T16:37:55.248197+0000","last_clean":"2023-07-29T16:37:55.248197+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:37:55.248197+0000","last_undegraded":"2023-07-29T16:37:55.248197+0000","last_fullsized":"2023-07-29T16:37:55.248197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949376+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:37:54.949376+0000","last_peered":"2023-07-29T16:37:54.949376+0000","last_clean":"2023-07-29T16:37:54.949376+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:37:54.949376+0000","last_undegraded":"2023-07-29T16:37:54.949376+0000","last_fullsized":"2023-07-29T16:37:54.949376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248244+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:37:55.248244+0000","last_peered":"2023-07-29T16:37:55.248244+0000","last_clean":"2023-07-29T16:37:55.248244+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:37:55.248244+0000","last_undegraded":"2023-07-29T16:37:55.248244+0000","last_fullsized":"2023-07-29T16:37:55.248244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508467+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:37:55.508467+0000","last_peered":"2023-07-29T16:37:55.508467+0000","last_clean":"2023-07-29T16:37:55.508467+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:37:55.508467+0000","last_undegraded":"2023-07-29T16:37:55.508467+0000","last_fullsized":"2023-07-29T16:37:55.508467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.945297+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:37:53.945297+0000","last_peered":"2023-07-29T16:37:53.945297+0000","last_clean":"2023-07-29T16:37:53.945297+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:37:53.945297+0000","last_undegraded":"2023-07-29T16:37:53.945297+0000","last_fullsized":"2023-07-29T16:37:53.945297+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949210+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:37:54.949210+0000","last_peered":"2023-07-29T16:37:54.949210+0000","last_clean":"2023-07-29T16:37:54.949210+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:37:54.949210+0000","last_undegraded":"2023-07-29T16:37:54.949210+0000","last_fullsized":"2023-07-29T16:37:54.949210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248643+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:37:55.248643+0000","last_peered":"2023-07-29T16:37:55.248643+0000","last_clean":"2023-07-29T16:37:55.248643+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:37:55.248643+0000","last_undegraded":"2023-07-29T16:37:55.248643+0000","last_fullsized":"2023-07-29T16:37:55.248643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953236+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:37:53.953236+0000","last_peered":"2023-07-29T16:37:53.953236+0000","last_clean":"2023-07-29T16:37:53.953236+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:37:53.953236+0000","last_undegraded":"2023-07-29T16:37:53.953236+0000","last_fullsized":"2023-07-29T16:37:53.953236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948867+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:37:54.948867+0000","last_peered":"2023-07-29T16:37:54.948867+0000","last_clean":"2023-07-29T16:37:54.948867+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:37:54.948867+0000","last_undegraded":"2023-07-29T16:37:54.948867+0000","last_fullsized":"2023-07-29T16:37:54.948867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508319+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:37:55.508319+0000","last_peered":"2023-07-29T16:37:55.508319+0000","last_clean":"2023-07-29T16:37:55.508319+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:37:55.508319+0000","last_undegraded":"2023-07-29T16:37:55.508319+0000","last_fullsized":"2023-07-29T16:37:55.508319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.944622+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:37:53.944622+0000","last_peered":"2023-07-29T16:37:53.944622+0000","last_clean":"2023-07-29T16:37:53.944622+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:37:53.944622+0000","last_undegraded":"2023-07-29T16:37:53.944622+0000","last_fullsized":"2023-07-29T16:37:53.944622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248151+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:37:55.248151+0000","last_peered":"2023-07-29T16:37:55.248151+0000","last_clean":"2023-07-29T16:37:55.248151+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:37:55.248151+0000","last_undegraded":"2023-07-29T16:37:55.248151+0000","last_fullsized":"2023-07-29T16:37:55.248151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508502+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:37:55.508502+0000","last_peered":"2023-07-29T16:37:55.508502+0000","last_clean":"2023-07-29T16:37:55.508502+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:37:55.508502+0000","last_undegraded":"2023-07-29T16:37:55.508502+0000","last_fullsized":"2023-07-29T16:37:55.508502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.953570+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:37:53.953570+0000","last_peered":"2023-07-29T16:37:53.953570+0000","last_clean":"2023-07-29T16:37:53.953570+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:37:53.953570+0000","last_undegraded":"2023-07-29T16:37:53.953570+0000","last_fullsized":"2023-07-29T16:37:53.953570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952279+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:37:53.952279+0000","last_peered":"2023-07-29T16:37:53.952279+0000","last_clean":"2023-07-29T16:37:53.952279+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:37:53.952279+0000","last_undegraded":"2023-07-29T16:37:53.952279+0000","last_fullsized":"2023-07-29T16:37:53.952279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508220+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:37:55.508220+0000","last_peered":"2023-07-29T16:37:55.508220+0000","last_clean":"2023-07-29T16:37:55.508220+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:37:55.508220+0000","last_undegraded":"2023-07-29T16:37:55.508220+0000","last_fullsized":"2023-07-29T16:37:55.508220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949292+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:37:54.949292+0000","last_peered":"2023-07-29T16:37:54.949292+0000","last_clean":"2023-07-29T16:37:54.949292+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:37:54.949292+0000","last_undegraded":"2023-07-29T16:37:54.949292+0000","last_fullsized":"2023-07-29T16:37:54.949292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.952158+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:37:53.952158+0000","last_peered":"2023-07-29T16:37:53.952158+0000","last_clean":"2023-07-29T16:37:53.952158+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:37:53.952158+0000","last_undegraded":"2023-07-29T16:37:53.952158+0000","last_fullsized":"2023-07-29T16:37:53.952158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508140+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:37:55.508140+0000","last_peered":"2023-07-29T16:37:55.508140+0000","last_clean":"2023-07-29T16:37:55.508140+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:37:55.508140+0000","last_undegraded":"2023-07-29T16:37:55.508140+0000","last_fullsized":"2023-07-29T16:37:55.508140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249071+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:37:55.249071+0000","last_peered":"2023-07-29T16:37:55.249071+0000","last_clean":"2023-07-29T16:37:55.249071+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:37:55.249071+0000","last_undegraded":"2023-07-29T16:37:55.249071+0000","last_fullsized":"2023-07-29T16:37:55.249071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.957616+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:37:53.957616+0000","last_peered":"2023-07-29T16:37:53.957616+0000","last_clean":"2023-07-29T16:37:53.957616+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:37:53.957616+0000","last_undegraded":"2023-07-29T16:37:53.957616+0000","last_fullsized":"2023-07-29T16:37:53.957616+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508306+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:37:55.508306+0000","last_peered":"2023-07-29T16:37:55.508306+0000","last_clean":"2023-07-29T16:37:55.508306+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:37:55.508306+0000","last_undegraded":"2023-07-29T16:37:55.508306+0000","last_fullsized":"2023-07-29T16:37:55.508306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248732+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:37:55.248732+0000","last_peered":"2023-07-29T16:37:55.248732+0000","last_clean":"2023-07-29T16:37:55.248732+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:37:55.248732+0000","last_undegraded":"2023-07-29T16:37:55.248732+0000","last_fullsized":"2023-07-29T16:37:55.248732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508449+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:37:55.508449+0000","last_peered":"2023-07-29T16:37:55.508449+0000","last_clean":"2023-07-29T16:37:55.508449+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:37:55.508449+0000","last_undegraded":"2023-07-29T16:37:55.508449+0000","last_fullsized":"2023-07-29T16:37:55.508449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.946469+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:37:53.946469+0000","last_peered":"2023-07-29T16:37:53.946469+0000","last_clean":"2023-07-29T16:37:53.946469+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:37:53.946469+0000","last_undegraded":"2023-07-29T16:37:53.946469+0000","last_fullsized":"2023-07-29T16:37:53.946469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508098+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:37:55.508098+0000","last_peered":"2023-07-29T16:37:55.508098+0000","last_clean":"2023-07-29T16:37:55.508098+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:37:55.508098+0000","last_undegraded":"2023-07-29T16:37:55.508098+0000","last_fullsized":"2023-07-29T16:37:55.508098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:53.954529+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:37:53.954529+0000","last_peered":"2023-07-29T16:37:53.954529+0000","last_clean":"2023-07-29T16:37:53.954529+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:37:53.954529+0000","last_undegraded":"2023-07-29T16:37:53.954529+0000","last_fullsized":"2023-07-29T16:37:53.954529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.749476+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:37:55.749476+0000","last_peered":"2023-07-29T16:37:55.749476+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:37:55.749476+0000","last_undegraded":"2023-07-29T16:37:55.749476+0000","last_fullsized":"2023-07-29T16:37:55.749476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248410+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:37:55.248410+0000","last_peered":"2023-07-29T16:37:55.248410+0000","last_clean":"2023-07-29T16:37:55.248410+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:37:55.248410+0000","last_undegraded":"2023-07-29T16:37:55.248410+0000","last_fullsized":"2023-07-29T16:37:55.248410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248382+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:37:55.248382+0000","last_peered":"2023-07-29T16:37:55.248382+0000","last_clean":"2023-07-29T16:37:55.248382+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:37:55.248382+0000","last_undegraded":"2023-07-29T16:37:55.248382+0000","last_fullsized":"2023-07-29T16:37:55.248382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248916+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:37:55.248916+0000","last_peered":"2023-07-29T16:37:55.248916+0000","last_clean":"2023-07-29T16:37:55.248916+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:37:55.248916+0000","last_undegraded":"2023-07-29T16:37:55.248916+0000","last_fullsized":"2023-07-29T16:37:55.248916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948971+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:37:54.948971+0000","last_peered":"2023-07-29T16:37:54.948971+0000","last_clean":"2023-07-29T16:37:54.948971+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:37:54.948971+0000","last_undegraded":"2023-07-29T16:37:54.948971+0000","last_fullsized":"2023-07-29T16:37:54.948971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.949126+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:37:54.949126+0000","last_peered":"2023-07-29T16:37:54.949126+0000","last_clean":"2023-07-29T16:37:54.949126+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:37:54.949126+0000","last_undegraded":"2023-07-29T16:37:54.949126+0000","last_fullsized":"2023-07-29T16:37:54.949126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.249192+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:37:55.249192+0000","last_peered":"2023-07-29T16:37:55.249192+0000","last_clean":"2023-07-29T16:37:55.249192+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:37:55.249192+0000","last_undegraded":"2023-07-29T16:37:55.249192+0000","last_fullsized":"2023-07-29T16:37:55.249192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948591+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:37:54.948591+0000","last_peered":"2023-07-29T16:37:54.948591+0000","last_clean":"2023-07-29T16:37:54.948591+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:37:54.948591+0000","last_undegraded":"2023-07-29T16:37:54.948591+0000","last_fullsized":"2023-07-29T16:37:54.948591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508408+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:37:55.508408+0000","last_peered":"2023-07-29T16:37:55.508408+0000","last_clean":"2023-07-29T16:37:55.508408+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:37:55.508408+0000","last_undegraded":"2023-07-29T16:37:55.508408+0000","last_fullsized":"2023-07-29T16:37:55.508408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248120+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:37:55.248120+0000","last_peered":"2023-07-29T16:37:55.248120+0000","last_clean":"2023-07-29T16:37:55.248120+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:37:55.248120+0000","last_undegraded":"2023-07-29T16:37:55.248120+0000","last_fullsized":"2023-07-29T16:37:55.248120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508481+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:37:55.508481+0000","last_peered":"2023-07-29T16:37:55.508481+0000","last_clean":"2023-07-29T16:37:55.508481+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:37:55.508481+0000","last_undegraded":"2023-07-29T16:37:55.508481+0000","last_fullsized":"2023-07-29T16:37:55.508481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948563+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:37:54.948563+0000","last_peered":"2023-07-29T16:37:54.948563+0000","last_clean":"2023-07-29T16:37:54.948563+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:37:54.948563+0000","last_undegraded":"2023-07-29T16:37:54.948563+0000","last_fullsized":"2023-07-29T16:37:54.948563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:54.948423+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:37:54.948423+0000","last_peered":"2023-07-29T16:37:54.948423+0000","last_clean":"2023-07-29T16:37:54.948423+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:37:54.948423+0000","last_undegraded":"2023-07-29T16:37:54.948423+0000","last_fullsized":"2023-07-29T16:37:54.948423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508162+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:37:55.508162+0000","last_peered":"2023-07-29T16:37:55.508162+0000","last_clean":"2023-07-29T16:37:55.508162+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:37:55.508162+0000","last_undegraded":"2023-07-29T16:37:55.508162+0000","last_fullsized":"2023-07-29T16:37:55.508162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248781+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:37:55.248781+0000","last_peered":"2023-07-29T16:37:55.248781+0000","last_clean":"2023-07-29T16:37:55.248781+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:37:55.248781+0000","last_undegraded":"2023-07-29T16:37:55.248781+0000","last_fullsized":"2023-07-29T16:37:55.248781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.508293+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:37:55.508293+0000","last_peered":"2023-07-29T16:37:55.508293+0000","last_clean":"2023-07-29T16:37:55.508293+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:37:55.508293+0000","last_undegraded":"2023-07-29T16:37:55.508293+0000","last_fullsized":"2023-07-29T16:37:55.508293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-07-29T16:37:55.248996+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:37:55.248996+0000","last_peered":"2023-07-29T16:37:55.248996+0000","last_clean":"2023-07-29T16:37:55.248996+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:37:55.248996+0000","last_undegraded":"2023-07-29T16:37:55.248996+0000","last_fullsized":"2023-07-29T16:37:55.248996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":647190,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":647806,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:13.487 INFO:tasks.thrashosds.thrasher:Setting 4.d to [1, 0] 2023-07-29T16:38:13.487 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.d', '1', '0'] 2023-07-29T16:38:13.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.d 1 0 2023-07-29T16:38:13.547 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:13.546+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:13.559 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.560 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:13.648 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:13.647+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:13.709 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.709 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:13.749 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:13.747+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:13.849 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:13.849 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:13.850 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:13.848+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:13.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:13.950 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:13.948+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:13.996 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:38:13.996 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'unique_pool_0' created 2023-07-29T16:38:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:set 4.d pg_upmap mapping to [1,0] 2023-07-29T16:38:14.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2023-07-29T16:38:14.029 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.029 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:14.051 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:14.049+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:14.152 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:14.150+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:14.180 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.180 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:14.253 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.251+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.318 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.318 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:14.354 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.352+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.455 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:14.454+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:14.456 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.456 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.466 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:14.556 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.554+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.610 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.610 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:14.656 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.654+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.747 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.748 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:14.758 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.755+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.858 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:14.856+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:14.883 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:14.884 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:14.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:14.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:14.958 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:14.957+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:15.000 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rados' on pool 'unique_pool_0' 2023-07-29T16:38:15.028 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:15.029 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:15.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:15.076 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:15.083 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:15.081+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:15.095 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:15.115 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:15.115 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:15.116 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:15.116 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:15.161 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:15.159+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:15.166 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:15.166 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:15.167 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:15.167 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:15.167 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:15.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:15.262 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:15.261+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:15.346 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2023-07-29T16:38:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2023-07-29T16:38:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946612+0000", 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396397301, 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084397770000000007, 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946612+0000", 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946612+0000", 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946607+0000", 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999952 2023-07-29T16:38:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946621+0000", 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3551e-05 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946641+0000", 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9749999999999999e-05 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946655+0000", 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4497e-05 2023-07-29T16:38:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946795+0000", 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139908 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946927+0000", 2023-07-29T16:38:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013142199999999999 2023-07-29T16:38:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947084+0000", 2023-07-29T16:38:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000157169 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949392+0000", 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023085219999999999 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954967+0000", 2023-07-29T16:38:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055751799999999999 2023-07-29T16:38:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955008+0000", 2023-07-29T16:38:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2023-07-29T16:38:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955052+0000", 2023-07-29T16:38:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3741e-05 2023-07-29T16:38:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946676+0000", 2023-07-29T16:38:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396333539, 2023-07-29T16:38:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090129500000000005, 2023-07-29T16:38:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946676+0000", 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946676+0000", 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946675+0000", 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946689+0000", 2023-07-29T16:38:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4491999999999999e-05 2023-07-29T16:38:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4552000000000001e-05 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1736000000000001e-05 2023-07-29T16:38:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947539+0000", 2023-07-29T16:38:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00082363900000000003 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012881500000000001 2023-07-29T16:38:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947824+0000", 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015582200000000001 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949398+0000", 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015741150000000001 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955610+0000", 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062119410000000003 2023-07-29T16:38:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955662+0000", 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1996999999999997e-05 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955689+0000", 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6662999999999999e-05 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396285776999999, 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012045804, 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946723+0000", 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946728+0000", 2023-07-29T16:38:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6710000000000004e-06 2023-07-29T16:38:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946739+0000", 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0302000000000001e-05 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946745+0000", 2023-07-29T16:38:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3380000000000001e-06 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947643+0000", 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00089792400000000003 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947778+0000", 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134473 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947896+0000", 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118819 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949405+0000", 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015087760000000001 2023-07-29T16:38:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958678+0000", 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092725199999999994 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958731+0000", 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3455999999999998e-05 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958769+0000", 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8279999999999999e-05 2023-07-29T16:38:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396257736999999, 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012493715000000001, 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946751+0000", 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946756+0000", 2023-07-29T16:38:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9980000000000003e-06 2023-07-29T16:38:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946763+0000", 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3050000000000004e-06 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946769+0000", 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8309999999999997e-06 2023-07-29T16:38:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948196+0000", 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001426877 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948287+0000", 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1199000000000006e-05 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948678+0000", 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000390348 2023-07-29T16:38:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.950174+0000", 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00149595 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958817+0000", 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086438969999999993 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958870+0000", 2023-07-29T16:38:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2166999999999997e-05 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959245+0000", 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037570700000000003 2023-07-29T16:38:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946775+0000", 2023-07-29T16:38:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396233941999999, 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090503909999999996, 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946775+0000", 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946775+0000", 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946775+0000", 2023-07-29T16:38:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946778+0000", 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0259999999999999e-06 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6099999999999997e-06 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9240000000000004e-06 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948202+0000", 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001412125 2023-07-29T16:38:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948537+0000", 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033572700000000002 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948654+0000", 2023-07-29T16:38:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116507 2023-07-29T16:38:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.950593+0000", 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00193892 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955723+0000", 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051300419999999996 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955790+0000", 2023-07-29T16:38:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7464000000000003e-05 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955826+0000", 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5407999999999997e-05 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946795+0000", 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396214570000001, 2023-07-29T16:38:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082626490000000004, 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946795+0000", 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946795+0000", 2023-07-29T16:38:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946794+0000", 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946798+0000", 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9570000000000004e-06 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946804+0000", 2023-07-29T16:38:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0909999999999998e-06 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946810+0000", 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4280000000000004e-06 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946914+0000", 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104744 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947041+0000", 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012691499999999999 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947190+0000", 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014884800000000001 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948724+0000", 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015342349999999999 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954958+0000", 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062331399999999999 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955011+0000", 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3884000000000001e-05 2023-07-29T16:38:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955057+0000", 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016000000000001e-05 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396119560999999, 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083335679999999995, 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946886+0000", 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999962 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946896+0000", 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4290000000000007e-06 2023-07-29T16:38:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946917+0000", 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1246e-05 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946927+0000", 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.028e-05 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948781+0000", 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001854318 2023-07-29T16:38:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948903+0000", 2023-07-29T16:38:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121347 2023-07-29T16:38:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955223+0000", 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063205409999999998 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396073770000001, 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012871102000000001, 2023-07-29T16:38:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946935+0000", 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946939+0000", 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9910000000000004e-06 2023-07-29T16:38:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946947+0000", 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5120000000000008e-06 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946954+0000", 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2219999999999996e-06 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949468+0000", 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025132219999999999 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949824+0000", 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035664300000000002 2023-07-29T16:38:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959807+0000", 2023-07-29T16:38:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099823480000000003 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.396049134999998, 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098516839999999994, 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946979+0000", 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9008000000000002e-05 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946986+0000", 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6210000000000004e-06 2023-07-29T16:38:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946993+0000", 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4899999999999997e-06 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947745+0000", 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075184399999999999 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947872+0000", 2023-07-29T16:38:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012691499999999999 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.956812+0000", 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0089402519999999992 2023-07-29T16:38:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 7 lcod 17'2)", 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.954842+0000", 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.388166990999999, 2023-07-29T16:38:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041168299999999998, 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954842+0000", 2023-07-29T16:38:15.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954842+0000", 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954842+0000", 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954845+0000", 2023-07-29T16:38:15.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.365e-06 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954854+0000", 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4940000000000003e-06 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954862+0000", 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4169999999999992e-06 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955083+0000", 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022071699999999999 2023-07-29T16:38:15.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955254+0000", 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000171044 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e16/15 ondisk, result = 0)", 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.954961+0000", 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.388048677, 2023-07-29T16:38:15.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000736179, 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954961+0000", 2023-07-29T16:38:15.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954961+0000", 2023-07-29T16:38:15.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954960+0000", 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954963+0000", 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0120000000000001e-06 2023-07-29T16:38:15.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954971+0000", 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6009999999999997e-06 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954977+0000", 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6890000000000001e-06 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955595+0000", 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061818400000000003 2023-07-29T16:38:15.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955604+0000", 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1139999999999995e-06 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955697+0000", 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2894999999999997e-05 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:30 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2023-07-29T16:38:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.954981+0000", 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.388028174999999, 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022030859999999999, 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954981+0000", 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954981+0000", 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.954981+0000", 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955001+0000", 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9721999999999999e-05 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955009+0000", 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6549999999999993e-06 2023-07-29T16:38:15.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955015+0000", 2023-07-29T16:38:15.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0619999999999997e-06 2023-07-29T16:38:15.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955289+0000", 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000273897 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955315+0000", 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6020000000000002e-05 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957143+0000", 2023-07-29T16:38:15.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001828035 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957184+0000", 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1012e-05 2023-07-29T16:38:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.955022+0000", 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.387987165999998, 2023-07-29T16:38:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00081006399999999999, 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955022+0000", 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955022+0000", 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955022+0000", 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955025+0000", 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1149999999999998e-06 2023-07-29T16:38:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955031+0000", 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6239999999999999e-06 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955035+0000", 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955715+0000", 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068012400000000005 2023-07-29T16:38:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955720+0000", 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5850000000000001e-06 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955832+0000", 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112372 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.955041+0000", 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.387968674, 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002094126, 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955041+0000", 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955041+0000", 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955040+0000", 2023-07-29T16:38:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955049+0000", 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9139999999999997e-06 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955055+0000", 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955060+0000", 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.215e-06 2023-07-29T16:38:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955164+0000", 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103946 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.955185+0000", 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1404999999999999e-05 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957095+0000", 2023-07-29T16:38:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019100619999999999 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957135+0000", 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9337e-05 2023-07-29T16:38:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e16/15 ondisk, result = 0)", 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.957360+0000", 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.385649029, 2023-07-29T16:38:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001416912, 2023-07-29T16:38:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957360+0000", 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957360+0000", 2023-07-29T16:38:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957360+0000", 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957364+0000", 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3499999999999999e-06 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957371+0000", 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3359999999999997e-06 2023-07-29T16:38:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957386+0000", 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4422e-05 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958660+0000", 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001274262 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958671+0000", 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0954e-05 2023-07-29T16:38:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958777+0000", 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106117 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e16/15 ondisk, result = 0)", 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.957392+0000", 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.385617649, 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018853139999999999, 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957392+0000", 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957392+0000", 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957391+0000", 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957394+0000", 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.588e-06 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957401+0000", 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957407+0000", 2023-07-29T16:38:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0209999999999996e-06 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958808+0000", 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001400887 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958814+0000", 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5670000000000002e-06 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959277+0000", 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046334399999999997 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 0 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2023-07-29T16:38:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.957635+0000", 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.385374016, 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017847379999999999, 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957635+0000", 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957635+0000", 2023-07-29T16:38:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957629+0000", 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999933 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957644+0000", 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5741000000000001e-05 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957656+0000", 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2013e-05 2023-07-29T16:38:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957668+0000", 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1671999999999999e-05 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.957732+0000", 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3930000000000006e-05 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001688113 2023-07-29T16:38:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.960238+0000", 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.382771376000001, 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018256489999999999, 2023-07-29T16:38:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960238+0000", 2023-07-29T16:38:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960238+0000", 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960237+0000", 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960251+0000", 2023-07-29T16:38:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3794999999999999e-05 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960301+0000", 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9675000000000001e-05 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960309+0000", 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3809999999999999e-06 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960356+0000", 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6826000000000002e-05 2023-07-29T16:38:15.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960377+0000", 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0979999999999999e-05 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.962031+0000", 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001654083 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.962064+0000", 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2418e-05 2023-07-29T16:38:15.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.960392+0000", 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.382617664000001, 2023-07-29T16:38:15.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00166942, 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960392+0000", 2023-07-29T16:38:15.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960392+0000", 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960391+0000", 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960398+0000", 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7549999999999997e-06 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960404+0000", 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2820000000000002e-06 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960410+0000", 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.339e-06 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960445+0000", 2023-07-29T16:38:15.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5213000000000003e-05 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.960465+0000", 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0228999999999999e-05 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.962018+0000", 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001552772 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.962061+0000", 2023-07-29T16:38:15.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.337e-05 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-07-29T16:38:15.521 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:58.640529+0000", 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.702480055999999, 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019929100000000001, 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:15.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640529+0000", 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640529+0000", 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640526+0000", 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999971 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:15.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640542+0000", 2023-07-29T16:38:15.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5339e-05 2023-07-29T16:38:15.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:15.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640576+0000", 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4885999999999998e-05 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640594+0000", 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7407000000000001e-05 2023-07-29T16:38:15.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640721+0000", 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012761700000000001 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:15.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640839+0000", 2023-07-29T16:38:15.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011733799999999999 2023-07-29T16:38:15.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:15.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.640965+0000", 2023-07-29T16:38:15.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012626400000000001 2023-07-29T16:38:15.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:15.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.641642+0000", 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000677201 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.642438+0000", 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079551000000000003 2023-07-29T16:38:15.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:15.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.642476+0000", 2023-07-29T16:38:15.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8526999999999999e-05 2023-07-29T16:38:15.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:58.642522+0000", 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5861e-05 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.532 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:15.533 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:15.533 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:15.534 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:15.532+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:15.534 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:15.635 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:15.633+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:15.673 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:15.674 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:15.674 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:38:15.675 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:15.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:15.736 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:15.735+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:15.837 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:15.834+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:15.850 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:15.851 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:15.851 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:15.851 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:15.852 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:15.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:15.937 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:15.936+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:16.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:38:16.013 DEBUG:teuthology.orchestra.run.smithi070:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2023-07-29T16:38:16.017 INFO:teuthology.run_tasks:Running task admin_socket... 2023-07-29T16:38:16.054 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2023-07-29T16:38:16.055 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2023-07-29T16:38:16.057 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'70)", 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.785627+0000", 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.237947275000003, 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052360449999999999, 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785627+0000", 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785627+0000", 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785627+0000", 2023-07-29T16:38:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785633+0000", 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9599999999999997e-06 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785639+0000", 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5719999999999999e-06 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785644+0000", 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649999999999997e-06 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785665+0000", 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0839000000000002e-05 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.785676+0000", 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0375e-05 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.790841+0000", 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051651730000000003 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.790863+0000", 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2302000000000001e-05 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'70)", 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.786115+0000", 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.237459508999997, 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047593649999999998, 2023-07-29T16:38:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786115+0000", 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786115+0000", 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786114+0000", 2023-07-29T16:38:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786119+0000", 2023-07-29T16:38:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6970000000000001e-06 2023-07-29T16:38:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786125+0000", 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3280000000000002e-06 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786132+0000", 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5400000000000001e-06 2023-07-29T16:38:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786179+0000", 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6891000000000002e-05 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.786193+0000", 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4209000000000001e-05 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.790864+0000", 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046713170000000004 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.790874+0000", 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7249999999999992e-06 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.894036+0000", 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.129537904000003, 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056244529999999997, 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894036+0000", 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894036+0000", 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894036+0000", 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894091+0000", 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5204000000000002e-05 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894100+0000", 2023-07-29T16:38:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4129999999999995e-06 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894106+0000", 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7509999999999997e-06 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894128+0000", 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2175999999999999e-05 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894139+0000", 2023-07-29T16:38:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0565e-05 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.899634+0000", 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054952849999999999 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.899661+0000", 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6577e-05 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.894514+0000", 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.129060451000001, 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051663799999999999, 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894514+0000", 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894514+0000", 2023-07-29T16:38:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894513+0000", 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894519+0000", 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1819999999999997e-06 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894525+0000", 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5819999999999998e-06 2023-07-29T16:38:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894541+0000", 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716e-05 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894565+0000", 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3791e-05 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.894578+0000", 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2882e-05 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.899663+0000", 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050850879999999998 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.899680+0000", 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7509000000000001e-05 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:137 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'95, mlcod=10'86)", 2023-07-29T16:38:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.896760+0000", 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.126813839, 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057487379999999998, 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896760+0000", 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896760+0000", 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896760+0000", 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896846+0000", 2023-07-29T16:38:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6374999999999999e-05 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896855+0000", 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1440000000000003e-06 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896860+0000", 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.536e-06 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896897+0000", 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7178000000000002e-05 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.896917+0000", 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0047999999999998e-05 2023-07-29T16:38:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.902482+0000", 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055648080000000001 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.902509+0000", 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6968e-05 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:138 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'96, mlcod=10'86)", 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:42.897297+0000", 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.126276808, 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052245649999999996, 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897297+0000", 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897297+0000", 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897297+0000", 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897300+0000", 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3739999999999998e-06 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897309+0000", 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2290000000000003e-06 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897314+0000", 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2120000000000002e-06 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897355+0000", 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0785000000000003e-05 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.897367+0000", 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2252000000000001e-05 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.902511+0000", 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051441910000000002 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:42.902522+0000", 2023-07-29T16:38:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0866999999999999e-05 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:43.289639+0000", 2023-07-29T16:38:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.733935426999999, 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051652770000000002, 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289639+0000", 2023-07-29T16:38:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289639+0000", 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289638+0000", 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289642+0000", 2023-07-29T16:38:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289651+0000", 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9959999999999999e-06 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289657+0000", 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6829999999999996e-06 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289682+0000", 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5210000000000001e-05 2023-07-29T16:38:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.289694+0000", 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2317000000000001e-05 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.294773+0000", 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050786950000000003 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.294804+0000", 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1061e-05 2023-07-29T16:38:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4156.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'147)", 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:43.292773+0000", 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.730801220000004, 2023-07-29T16:38:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048195490000000002, 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292773+0000", 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292773+0000", 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292773+0000", 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292776+0000", 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292784+0000", 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6149999999999997e-06 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292790+0000", 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1909999999999999e-06 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292866+0000", 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6001999999999995e-05 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.292881+0000", 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5130000000000001e-05 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.297566+0000", 2023-07-29T16:38:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046854929999999998 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:43.297593+0000", 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6412999999999999e-05 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.076263684000001, 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075962699000002, 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075929944999999, 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075899064000001, 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075877693999999, 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075843248000002, 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075821570999999, 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075343192999998, 2023-07-29T16:38:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.075303873999999, 2023-07-29T16:38:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012841247, 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948282+0000", 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948292+0000", 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1570000000000006e-06 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948300+0000", 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3189999999999995e-06 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948961+0000", 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066065600000000003 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948982+0000", 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1588999999999999e-05 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953445+0000", 2023-07-29T16:38:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044624970000000002 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953666+0000", 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022092699999999999 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961112+0000", 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074460000000000004 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948903+0000", 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.074670932, 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050585099999999996, 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948903+0000", 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948903+0000", 2023-07-29T16:38:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948903+0000", 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948909+0000", 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0140000000000004e-06 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948925+0000", 2023-07-29T16:38:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6503000000000001e-05 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948934+0000", 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0319999999999992e-06 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.951103+0000", 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002168906 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.951128+0000", 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5038999999999999e-05 2023-07-29T16:38:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953911+0000", 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027823520000000001 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953962+0000", 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1088999999999998e-05 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2023-07-29T16:38:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.949706+0000", 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.073868041000001, 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004777346, 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949706+0000", 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949706+0000", 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949706+0000", 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949712+0000", 2023-07-29T16:38:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4899999999999997e-06 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949719+0000", 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2259999999999999e-06 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949726+0000", 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0530000000000003e-06 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.952194+0000", 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024681360000000001 2023-07-29T16:38:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.952212+0000", 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8510000000000001e-05 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.954461+0000", 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022491640000000001 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.954484+0000", 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2198e-05 2023-07-29T16:38:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.955630+0000", 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.067944434000001, 2023-07-29T16:38:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063887630000000004, 2023-07-29T16:38:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955630+0000", 2023-07-29T16:38:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955630+0000", 2023-07-29T16:38:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955629+0000", 2023-07-29T16:38:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955652+0000", 2023-07-29T16:38:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2580000000000001e-05 2023-07-29T16:38:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955661+0000", 2023-07-29T16:38:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5780000000000005e-06 2023-07-29T16:38:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.955671+0000", 2023-07-29T16:38:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5910000000000002e-06 2023-07-29T16:38:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958344+0000", 2023-07-29T16:38:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002672977 2023-07-29T16:38:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958360+0000", 2023-07-29T16:38:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6370000000000001e-05 2023-07-29T16:38:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961981+0000", 2023-07-29T16:38:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036206680000000001 2023-07-29T16:38:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962019+0000", 2023-07-29T16:38:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7741999999999999e-05 2023-07-29T16:38:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:16.260 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:16.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:16.265 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:16.055+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:16.266 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:16.262+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:16.267 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:hints = 1 2023-07-29T16:38:16.267 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2023-07-29T16:38:16.267 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Object prefix: benchmark_data_smithi070_97781 2023-07-29T16:38:16.268 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-07-29T16:38:16.268 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 0 0 0 0 0 0 - 0 2023-07-29T16:38:16.279 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef-release'} 2023-07-29T16:38:16.280 DEBUG:teuthology.orchestra.run.smithi070:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph-ci.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef-release' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-07-29T16:38:16.364 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:16.362+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:16.428 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:16.428 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:1161 5.f 5:f21c7e25:::benchmark_data_smithi070_97781_object1160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:16.422921+0000", 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0037091580000000002, 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037341499999999999, 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.429 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1161 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.422921+0000", 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.422921+0000", 2023-07-29T16:38:16.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.422920+0000", 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.422992+0000", 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1649000000000005e-05 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.422998+0000", 2023-07-29T16:38:16.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9730000000000002e-06 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423002+0000", 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8369999999999999e-06 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423034+0000", 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.201e-05 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423146+0000", 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111891 2023-07-29T16:38:16.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423291+0000", 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000145702 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423918+0000", 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062635200000000005 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.437 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:1162 5.9 5:9579a7a9:::benchmark_data_smithi070_97781_object1161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:16.423009+0000", 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003620987, 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037063590000000002, 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1162 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423009+0000", 2023-07-29T16:38:16.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423009+0000", 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423009+0000", 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423085+0000", 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6237999999999998e-05 2023-07-29T16:38:16.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423090+0000", 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.78e-06 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423093+0000", 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2279999999999998e-06 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423129+0000", 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6100000000000003e-05 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423249+0000", 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000120127 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.423387+0000", 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013817899999999999 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.424277+0000", 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00089005699999999998 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.445 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:1178 5.f 5:f7cca7a8:::benchmark_data_smithi070_97781_object1177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:16.426565+0000", 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 6.4758000000000006e-05, 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019780500000000001, 2023-07-29T16:38:16.446 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1178 2023-07-29T16:38:16.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426565+0000", 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426565+0000", 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426565+0000", 2023-07-29T16:38:16.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426656+0000", 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1005e-05 2023-07-29T16:38:16.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426664+0000", 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5029999999999997e-06 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426669+0000", 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7700000000000001e-06 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426698+0000", 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9456999999999999e-05 2023-07-29T16:38:16.452 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:1161 5.f e21/19)", 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:16.426772+0000", 2023-07-29T16:38:16.453 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9998584, 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2094000000000001e-05, 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426772+0000", 2023-07-29T16:38:16.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426772+0000", 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426771+0000", 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426775+0000", 2023-07-29T16:38:16.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5360000000000001e-06 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426783+0000", 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1319999999999994e-06 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426792+0000", 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9230000000000008e-06 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:1162 5.9 e21/19 ondisk, result = 0)", 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:16.426799+0000", 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9998312, 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1588999999999996e-05, 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426799+0000", 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426799+0000", 2023-07-29T16:38:16.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426799+0000", 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967296 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426800+0000", 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7770000000000001e-06 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426803+0000", 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2090000000000001e-06 2023-07-29T16:38:16.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426806+0000", 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4609999999999998e-06 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426837+0000", 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0737000000000001e-05 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:16.426845+0000", 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9529999999999999e-06 2023-07-29T16:38:16.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 5 2023-07-29T16:38:16.465 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:16.466 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:16.464+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:16.467 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:16.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2023-07-29T16:38:16.567 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:16.566+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:16.635 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:16.635 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:16.635 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:16.635 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:16.635 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:16.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:16.668 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:16.665+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:16.680 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:16.680 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2260, 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.d4a3868d", 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2259", 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.681 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2259", 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.096624s", 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0049998509999999996, 2023-07-29T16:38:16.682 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.674362+0000", 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2265, 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.775da9eb", 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2264", 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.684 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2264", 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.097624s", 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039998810000000003, 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.685 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.675539+0000", 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2266, 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.7646623e", 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2265", 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2265", 2023-07-29T16:38:16.687 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.688 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.675801+0000", 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2270, 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.55513b58", 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2269", 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2269", 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.690 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.691 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676047+0000", 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2274, 2023-07-29T16:38:16.692 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.ecba2f28", 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2273", 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2273", 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.693 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676454+0000", 2023-07-29T16:38:16.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2276, 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.49fb5c7d", 2023-07-29T16:38:16.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2275", 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2275", 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.696 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.099624s", 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00199994, 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.677084+0000", 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.697 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2277, 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.1e0f191d", 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.698 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2276", 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2276", 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.100624s", 2023-07-29T16:38:16.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00099996999999999998, 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.677744+0000", 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2278, 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.d28079d", 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2277", 2023-07-29T16:38:16.701 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2277", 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.100624s", 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00099996999999999998, 2023-07-29T16:38:16.702 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.678328+0000", 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2279, 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.be7ff76b", 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2278", 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.704 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2278", 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.101624s", 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0, 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.705 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.678704+0000", 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2267, 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.e4a46e52", 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2266", 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2266", 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.707 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.708 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.675940+0000", 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271, 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.ed0d6572", 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2270", 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2270", 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.710 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.711 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676103+0000", 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2275, 2023-07-29T16:38:16.712 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.59151e12", 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2274", 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2274", 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.713 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.099624s", 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00199994, 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676883+0000", 2023-07-29T16:38:16.714 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2268, 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.e342bb6c", 2023-07-29T16:38:16.715 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2267", 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2267", 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.716 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676028+0000", 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.717 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2269, 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.9d851e45", 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:16.718 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2268", 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2268", 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676041+0000", 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2272, 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.ecc38745", 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2271", 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.721 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2271", 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.722 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676204+0000", 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2273, 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "pg": "5.fc369195", 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "object_id": "benchmark_data_smithi070_97781_object2272", 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "object_locator": "@5", 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_id": "benchmark_data_smithi070_97781_object2272", 2023-07-29T16:38:16.724 INFO:teuthology.orchestra.run.smithi070.stdout: "target_object_locator": "@5", 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "paused": 0, 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "used_replica": 0, 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "precalc_pgid": 0, 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "last_sent": "808.098624s", 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029999100000000002, 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "attempts": 1, 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "snapid": "head", 2023-07-29T16:38:16.725 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_context": "0=[]", 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: "mtime": "2023-07-29T16:38:16.676338+0000", 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ops": [ 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: "write 0~65536 in=65536b" 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:16.726 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ops": [], 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ops": [], 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_stat_ops": [], 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_ops": [], 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout: "command_ops": [] 2023-07-29T16:38:16.727 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:16.728 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 2260, "pg": "5.d4a3868d", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2259", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2259", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.096624s", "age": 0.0049998509999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.674362+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2265, "pg": "5.775da9eb", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2264", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2264", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.097624s", "age": 0.0039998810000000003, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.675539+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2266, "pg": "5.7646623e", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2265", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2265", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.675801+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2270, "pg": "5.55513b58", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2269", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2269", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676047+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2274, "pg": "5.ecba2f28", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2273", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2273", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676454+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2276, "pg": "5.49fb5c7d", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2275", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2275", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.099624s", "age": 0.00199994, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.677084+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2277, "pg": "5.1e0f191d", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2276", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2276", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.100624s", "age": 0.00099996999999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.677744+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2278, "pg": "5.d28079d", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2277", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2277", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.100624s", "age": 0.00099996999999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.678328+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2279, "pg": "5.be7ff76b", "osd": 0, "object_id": "benchmark_data_smithi070_97781_object2278", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2278", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.101624s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.678704+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2267, "pg": "5.e4a46e52", "osd": 1, "object_id": "benchmark_data_smithi070_97781_object2266", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2266", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.675940+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2271, "pg": "5.ed0d6572", "osd": 1, "object_id": "benchmark_data_smithi070_97781_object2270", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2270", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676103+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2275, "pg": "5.59151e12", "osd": 1, "object_id": "benchmark_data_smithi070_97781_object2274", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2274", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.099624s", "age": 0.00199994, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676883+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2268, "pg": "5.e342bb6c", "osd": 2, "object_id": "benchmark_data_smithi070_97781_object2267", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2267", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676028+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2269, "pg": "5.9d851e45", "osd": 2, "object_id": "benchmark_data_smithi070_97781_object2268", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2268", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676041+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2272, "pg": "5.ecc38745", "osd": 2, "object_id": "benchmark_data_smithi070_97781_object2271", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2271", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676204+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2273, "pg": "5.fc369195", "osd": 2, "object_id": "benchmark_data_smithi070_97781_object2272", "object_locator": "@5", "target_object_id": "benchmark_data_smithi070_97781_object2272", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "808.098624s", "age": 0.0029999100000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2023-07-29T16:38:16.676338+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2023-07-29T16:38:16.729 DEBUG:teuthology.orchestra.run.smithi070:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2023-07-29T16:38:16.769 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:16.767+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:16.771 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2023-07-29T16:38:16.827 DEBUG:teuthology.parallel:result is None 2023-07-29T16:38:16.827 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2023-07-29T16:38:16.836 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2023-07-29T16:38:16.836 INFO:teuthology.orchestra.run:waiting for 2100 2023-07-29T16:38:16.869 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:16.867+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.923 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.395942320000003, 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.924 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:16.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:16.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:16.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:16.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:16.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:16.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:16.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:16.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:16.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:16.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:16.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:16.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:16.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.939 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.940 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.941 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:16.941 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.971059154999999, 2023-07-29T16:38:16.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015080049999999999, 2023-07-29T16:38:16.941 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.942 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.942 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:16.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:16.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946369+0000", 2023-07-29T16:38:16.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:16.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946378+0000", 2023-07-29T16:38:16.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8060000000000001e-06 2023-07-29T16:38:16.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946389+0000", 2023-07-29T16:38:16.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1250000000000001e-05 2023-07-29T16:38:16.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946402+0000", 2023-07-29T16:38:16.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2143e-05 2023-07-29T16:38:16.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948774+0000", 2023-07-29T16:38:16.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023720920000000001 2023-07-29T16:38:16.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:16.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948780+0000", 2023-07-29T16:38:16.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8680000000000004e-06 2023-07-29T16:38:16.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952342+0000", 2023-07-29T16:38:16.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035620199999999999 2023-07-29T16:38:16.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952751+0000", 2023-07-29T16:38:16.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040939399999999999 2023-07-29T16:38:16.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952906+0000", 2023-07-29T16:38:16.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000154776 2023-07-29T16:38:16.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958270+0000", 2023-07-29T16:38:16.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053643049999999998 2023-07-29T16:38:16.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961358+0000", 2023-07-29T16:38:16.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030884549999999999 2023-07-29T16:38:16.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:16.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961411+0000", 2023-07-29T16:38:16.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2608999999999997e-05 2023-07-29T16:38:16.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:16.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961451+0000", 2023-07-29T16:38:16.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9889999999999999e-05 2023-07-29T16:38:16.961 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.961 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.962 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.962 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.962 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.971013269, 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015461422000000001, 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:16.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946416+0000", 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946421+0000", 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7140000000000001e-06 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946428+0000", 2023-07-29T16:38:16.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2660000000000004e-06 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946438+0000", 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0284e-05 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949297+0000", 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028585070000000001 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949308+0000", 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1445e-05 2023-07-29T16:38:16.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953255+0000", 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039465510000000004 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953337+0000", 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1692000000000003e-05 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953490+0000", 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015321900000000001 2023-07-29T16:38:16.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958277+0000", 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047871550000000004 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961774+0000", 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00349672 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961837+0000", 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2967999999999997e-05 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961878+0000", 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1591000000000002e-05 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970985338999999, 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:16.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:16.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:16.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970960483999999, 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.985 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:16.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:16.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:16.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:16.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970928539999999, 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:16.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970906929000002, 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:17.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:17.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970882869, 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.018 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:17.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:17.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:17.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:17.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970847720999998, 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:17.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:17.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970811607000002, 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.051 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970786703999998, 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:17.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:17.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:17.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:17.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970753254999998, 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013415086, 2023-07-29T16:38:17.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946676+0000", 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946680+0000", 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1810000000000003e-06 2023-07-29T16:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946688+0000", 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946694+0000", 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0739999999999998e-06 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947354+0000", 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00066083699999999995 2023-07-29T16:38:17.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947362+0000", 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7249999999999997e-06 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954538+0000", 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0071760249999999999 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954651+0000", 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112422 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954775+0000", 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012481999999999999 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957415+0000", 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026398070000000001 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959812+0000", 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023968879999999998 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959860+0000", 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8276999999999999e-05 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960092+0000", 2023-07-29T16:38:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00023148799999999999 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970731731000001, 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:17.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:30 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946722+0000", 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970708165000001, 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012742253, 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.086 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946722+0000", 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946722+0000", 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946722+0000", 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946733+0000", 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1048e-05 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946745+0000", 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946751+0000", 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9109999999999998e-06 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948628+0000", 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018770810000000001 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948634+0000", 2023-07-29T16:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2889999999999997e-06 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954044+0000", 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054106670000000001 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954215+0000", 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170786 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954415+0000", 2023-07-29T16:38:17.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020011599999999999 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957124+0000", 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027090579999999999 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959365+0000", 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022408490000000001 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4517e-05 2023-07-29T16:38:17.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959464+0000", 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4465999999999997e-05 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970664414000002, 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:17.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:17.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:17.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:17.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:17.108 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970639495, 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:17.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:17.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:17.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:17.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:17.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.119 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970587951999999, 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:17.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:17.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:17.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970564004, 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016589201000000001, 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.131 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946869+0000", 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946880+0000", 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0614e-05 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946885+0000", 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6469999999999997e-06 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948666+0000", 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001781384 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948670+0000", 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9720000000000003e-06 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954685+0000", 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060152510000000001 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954828+0000", 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014298100000000001 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955312+0000", 2023-07-29T16:38:17.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048344000000000002 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958247+0000", 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029349749999999998 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963305+0000", 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050582989999999996 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963411+0000", 2023-07-29T16:38:17.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106001 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963455+0000", 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4478999999999999e-05 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970540368000002, 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.142 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:17.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:17.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:17.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:17.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:17.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.152 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 22.970517082000001, 2023-07-29T16:38:17.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:17.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:17.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:17.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:17.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:17.162 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:17.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:17.164 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:17.160+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:17.165 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:38:17.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:17.166 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 1 16 4314 4298 268.611 268.625 0.00198325 0.00371852 2023-07-29T16:38:17.264 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:17.262+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:17.352 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:17.359 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:17.359 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:17.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.359 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5706 5.5 5:a494842f:::benchmark_data_smithi070_97781_object5705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.359 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.354235+0000", 2023-07-29T16:38:17.360 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001925298, 2023-07-29T16:38:17.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019542560000000001, 2023-07-29T16:38:17.360 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.360 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:17.360 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5706 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354235+0000", 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354235+0000", 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354234+0000", 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354343+0000", 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108587 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354354+0000", 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1433e-05 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354362+0000", 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5730000000000002e-06 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356047+0000", 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00168564 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356153+0000", 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010597 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5707 5.c 5:3c371eb5:::benchmark_data_smithi070_97781_object5706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.367 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001791321, 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019109000000000001, 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.368 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5707 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354368+0000", 2023-07-29T16:38:17.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354434+0000", 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5664e-05 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354444+0000", 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0321e-05 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354451+0000", 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5810000000000002e-06 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354494+0000", 2023-07-29T16:38:17.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3167999999999997e-05 2023-07-29T16:38:17.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354608+0000", 2023-07-29T16:38:17.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113776 2023-07-29T16:38:17.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354783+0000", 2023-07-29T16:38:17.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017515200000000001 2023-07-29T16:38:17.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.378 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.379 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5709 5.c 5:3d19b354:::benchmark_data_smithi070_97781_object5708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.379 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.354463+0000", 2023-07-29T16:38:17.380 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0016973299999999999, 2023-07-29T16:38:17.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001912796, 2023-07-29T16:38:17.380 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5709 2023-07-29T16:38:17.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.383 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354463+0000", 2023-07-29T16:38:17.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354463+0000", 2023-07-29T16:38:17.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354462+0000", 2023-07-29T16:38:17.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354530+0000", 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7698000000000001e-05 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354540+0000", 2023-07-29T16:38:17.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0404999999999999e-05 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354547+0000", 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3799999999999999e-06 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355241+0000", 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00069393199999999997 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355360+0000", 2023-07-29T16:38:17.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011927200000000001 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355500+0000", 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013996500000000001 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.390 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:5704 5.7 e22/19 5:ec7fb529:::benchmark_data_smithi070_97781_object5703:head v 22'347, mlcod=22'345)", 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001790549, 2023-07-29T16:38:17.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020922169999999999, 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354369+0000", 2023-07-29T16:38:17.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354707+0000", 2023-07-29T16:38:17.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000338425 2023-07-29T16:38:17.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354718+0000", 2023-07-29T16:38:17.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0699e-05 2023-07-29T16:38:17.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354725+0000", 2023-07-29T16:38:17.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5320000000000003e-06 2023-07-29T16:38:17.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354799+0000", 2023-07-29T16:38:17.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4196000000000006e-05 2023-07-29T16:38:17.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354820+0000", 2023-07-29T16:38:17.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1049000000000001e-05 2023-07-29T16:38:17.401 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.401 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.401 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.402 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5710 5.a 5:5a0e6e3f:::benchmark_data_smithi070_97781_object5709:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.402 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.355189+0000", 2023-07-29T16:38:17.403 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00097137899999999997, 2023-07-29T16:38:17.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013581159999999999, 2023-07-29T16:38:17.403 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.403 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.404 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5710 2023-07-29T16:38:17.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.405 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355189+0000", 2023-07-29T16:38:17.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355189+0000", 2023-07-29T16:38:17.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355188+0000", 2023-07-29T16:38:17.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355247+0000", 2023-07-29T16:38:17.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9367000000000003e-05 2023-07-29T16:38:17.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355263+0000", 2023-07-29T16:38:17.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5145e-05 2023-07-29T16:38:17.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355271+0000", 2023-07-29T16:38:17.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2050000000000002e-06 2023-07-29T16:38:17.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355310+0000", 2023-07-29T16:38:17.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9341999999999997e-05 2023-07-29T16:38:17.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355438+0000", 2023-07-29T16:38:17.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012766700000000001 2023-07-29T16:38:17.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355594+0000", 2023-07-29T16:38:17.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156203 2023-07-29T16:38:17.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.417 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.418 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:5711 5.e e22/19 5:785ea044:::benchmark_data_smithi070_97781_object5710:head v 22'332, mlcod=22'330)", 2023-07-29T16:38:17.418 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.355692+0000", 2023-07-29T16:38:17.418 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00046813999999999997, 2023-07-29T16:38:17.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00095111700000000002, 2023-07-29T16:38:17.419 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:17.419 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355692+0000", 2023-07-29T16:38:17.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355692+0000", 2023-07-29T16:38:17.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355691+0000", 2023-07-29T16:38:17.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355756+0000", 2023-07-29T16:38:17.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4577000000000002e-05 2023-07-29T16:38:17.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355766+0000", 2023-07-29T16:38:17.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0277e-05 2023-07-29T16:38:17.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355773+0000", 2023-07-29T16:38:17.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3940000000000001e-06 2023-07-29T16:38:17.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355827+0000", 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4821999999999998e-05 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355853+0000", 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5318999999999999e-05 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5712 5.a 5:5a754f1b:::benchmark_data_smithi070_97781_object5711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.429 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.356238+0000", 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999218, 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00048581200000000002, 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5712 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356238+0000", 2023-07-29T16:38:17.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356238+0000", 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356238+0000", 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356306+0000", 2023-07-29T16:38:17.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8031e-05 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356314+0000", 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8259999999999993e-06 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356321+0000", 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2320000000000004e-06 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356358+0000", 2023-07-29T16:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7038e-05 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356428+0000", 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0152000000000002e-05 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356517+0000", 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9426999999999996e-05 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4749.0:5691 5.5 e22/19)", 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.356779+0000", 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9993811, 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5590000000000003e-05, 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2023-07-29T16:38:17.438 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356779+0000", 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356779+0000", 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356779+0000", 2023-07-29T16:38:17.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356781+0000", 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.181e-06 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356785+0000", 2023-07-29T16:38:17.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6430000000000003e-06 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356789+0000", 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1669999999999999e-06 2023-07-29T16:38:17.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356813+0000", 2023-07-29T16:38:17.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4981e-05 2023-07-29T16:38:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5691 5.5 5:a18ffa83:::benchmark_data_smithi070_97781_object5690:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.352000+0000", 2023-07-29T16:38:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004160314, 2023-07-29T16:38:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048871160000000004, 2023-07-29T16:38:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.448 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5691 2023-07-29T16:38:17.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.448 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352000+0000", 2023-07-29T16:38:17.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352000+0000", 2023-07-29T16:38:17.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.351999+0000", 2023-07-29T16:38:17.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:17.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352062+0000", 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3093000000000001e-05 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352084+0000", 2023-07-29T16:38:17.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2416e-05 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352100+0000", 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5814000000000001e-05 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353281+0000", 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011810760000000001 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353404+0000", 2023-07-29T16:38:17.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012224499999999999 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353538+0000", 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133996 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:17.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356548+0000", 2023-07-29T16:38:17.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030106 2023-07-29T16:38:17.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356871+0000", 2023-07-29T16:38:17.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032270900000000002 2023-07-29T16:38:17.458 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.458 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4749.0:5693 5.5 e22/19)", 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.356805+0000", 2023-07-29T16:38:17.459 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9993553, 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014220500000000001, 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356805+0000", 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356805+0000", 2023-07-29T16:38:17.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356804+0000", 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356806+0000", 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.733e-06 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356810+0000", 2023-07-29T16:38:17.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2023-07-29T16:38:17.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356812+0000", 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.695e-06 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.465 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4749.0:5702 5.5 e22/19)", 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.356820+0000", 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9993401, 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016829200000000001, 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356820+0000", 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356820+0000", 2023-07-29T16:38:17.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356820+0000", 2023-07-29T16:38:17.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967296 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356821+0000", 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3790000000000001e-06 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356824+0000", 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0769999999999999e-06 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356826+0000", 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3209999999999999e-06 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5693 5.5 5:a4b62b18:::benchmark_data_smithi070_97781_object5692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.352295+0000", 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003865393, 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047580859999999999, 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5693 2023-07-29T16:38:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352295+0000", 2023-07-29T16:38:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352295+0000", 2023-07-29T16:38:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352294+0000", 2023-07-29T16:38:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352328+0000", 2023-07-29T16:38:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4547e-05 2023-07-29T16:38:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352336+0000", 2023-07-29T16:38:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8690000000000004e-06 2023-07-29T16:38:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.352344+0000", 2023-07-29T16:38:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5739999999999998e-06 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354189+0000", 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018448869999999999 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354326+0000", 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013685499999999999 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354459+0000", 2023-07-29T16:38:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013293800000000001 2023-07-29T16:38:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.356665+0000", 2023-07-29T16:38:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022065990000000001 2023-07-29T16:38:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.357015+0000", 2023-07-29T16:38:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035020500000000003 2023-07-29T16:38:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.357046+0000", 2023-07-29T16:38:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1043000000000001e-05 2023-07-29T16:38:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5702 5.5 5:a6a9c529:::benchmark_data_smithi070_97781_object5701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.353590+0000", 2023-07-29T16:38:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025704790000000001, 2023-07-29T16:38:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035587589999999999, 2023-07-29T16:38:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5702 2023-07-29T16:38:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353590+0000", 2023-07-29T16:38:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353590+0000", 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353589+0000", 2023-07-29T16:38:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353680+0000", 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0947999999999997e-05 2023-07-29T16:38:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353690+0000", 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0135e-05 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353697+0000", 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3379999999999999e-06 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354875+0000", 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011780790000000001 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.354957+0000", 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1859000000000003e-05 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355060+0000", 2023-07-29T16:38:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102459 2023-07-29T16:38:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:5703 5.5 5:af0828a5:::benchmark_data_smithi070_97781_object5702:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2023-07-29T16:38:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:17.353702+0000", 2023-07-29T16:38:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024575299999999999, 2023-07-29T16:38:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035357660000000001, 2023-07-29T16:38:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 5703 2023-07-29T16:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353702+0000", 2023-07-29T16:38:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353702+0000", 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353702+0000", 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353730+0000", 2023-07-29T16:38:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7919000000000002e-05 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353736+0000", 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6919999999999999e-06 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.353740+0000", 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5600000000000004e-06 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355444+0000", 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001704253 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355534+0000", 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9795000000000003e-05 2023-07-29T16:38:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:17.355639+0000", 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105148 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2023-07-29T16:38:17.512 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:17.514 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:17.514 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:17.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:17.516 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:17.511+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:17.517 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:17.518 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:17.518 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:17.613 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:17.610+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:17.714 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:17.712+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:17.740 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:17.740 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:17.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:17.815 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:17.812+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:17.915 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:17.914+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:17.970 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:17.971 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:17.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:18.029 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:18.026+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:18.074 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 2 16 8485 8469 264.637 260.688 0.00183861 0.0037716 2023-07-29T16:38:18.117 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:18.116+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:18.145 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:18.145 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:18.160 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:18.218 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:18.216+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:18.318 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:18.316+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:18.365 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:18.365 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:18.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:18.419 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:18.417+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:18.520 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:18.518+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:18.535 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:18.536 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:18.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:18.621 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:18.620+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:18.712 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:18.712 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:18.722 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:18.720+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:18.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:18.823 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:18.820+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:18.923 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:18.921+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:18.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:19.014 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:19.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-07-29T16:38:19.025 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:19.023+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:19.074 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 3 15 11850 11835 246.545 210.375 0.00665613 0.00405077 2023-07-29T16:38:19.114 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:19.114 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:19.125 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:19.124+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:19.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:19.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:38:19.226 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:19.225+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:19.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:19.365 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:19.363+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:19.428 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:19.426+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:19.437 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2023-07-29T16:38:19.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-07-29T16:38:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:19.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:19.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:19.529 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:19.526+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:19.630 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:19.628+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:19.675 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:19.696 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:19.717 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:19.718 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:19.718 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:19.718 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:19.730 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:19.729+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:19.733 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2023-07-29T16:38:19.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.782948790999999, 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012045804, 2023-07-29T16:38:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946724+0000", 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946723+0000", 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946728+0000", 2023-07-29T16:38:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6710000000000004e-06 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946739+0000", 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0302000000000001e-05 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946745+0000", 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3380000000000001e-06 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947643+0000", 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00089792400000000003 2023-07-29T16:38:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947778+0000", 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134473 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947896+0000", 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118819 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949405+0000", 2023-07-29T16:38:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015087760000000001 2023-07-29T16:38:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958678+0000", 2023-07-29T16:38:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092725199999999994 2023-07-29T16:38:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958731+0000", 2023-07-29T16:38:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3455999999999998e-05 2023-07-29T16:38:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958769+0000", 2023-07-29T16:38:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8279999999999999e-05 2023-07-29T16:38:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.782920750999999, 2023-07-29T16:38:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012493715000000001, 2023-07-29T16:38:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946752+0000", 2023-07-29T16:38:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946751+0000", 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946756+0000", 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9980000000000003e-06 2023-07-29T16:38:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946763+0000", 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3050000000000004e-06 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946769+0000", 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8309999999999997e-06 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948196+0000", 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001426877 2023-07-29T16:38:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948287+0000", 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1199000000000006e-05 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.948678+0000", 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000390348 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.950174+0000", 2023-07-29T16:38:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00149595 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958817+0000", 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086438969999999993 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.958870+0000", 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2166999999999997e-05 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959245+0000", 2023-07-29T16:38:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037570700000000003 2023-07-29T16:38:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.782736784000001, 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012871102000000001, 2023-07-29T16:38:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946936+0000", 2023-07-29T16:38:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946935+0000", 2023-07-29T16:38:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946939+0000", 2023-07-29T16:38:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9910000000000004e-06 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946947+0000", 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5120000000000008e-06 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946954+0000", 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2219999999999996e-06 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949468+0000", 2023-07-29T16:38:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025132219999999999 2023-07-29T16:38:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.949824+0000", 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035664300000000002 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.959807+0000", 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099823480000000003 2023-07-29T16:38:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.782712148999998, 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098516839999999994, 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946960+0000", 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946979+0000", 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9008000000000002e-05 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946986+0000", 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6210000000000004e-06 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.946993+0000", 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4899999999999997e-06 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947745+0000", 2023-07-29T16:38:19.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075184399999999999 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.947872+0000", 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012691499999999999 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:37:53.956812+0000", 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0089402519999999992 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.778 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:683 5.3 5:c9b6285e:::benchmark_data_smithi070_97781_object682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.277965+0000", 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.4517077120000001, 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010282698, 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.779 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 683 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.277965+0000", 2023-07-29T16:38:19.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.277965+0000", 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.277964+0000", 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278006+0000", 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2493000000000001e-05 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278017+0000", 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0329999999999999e-05 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278022+0000", 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.198e-06 2023-07-29T16:38:19.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278049+0000", 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6959000000000001e-05 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278128+0000", 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9470999999999999e-05 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.278265+0000", 2023-07-29T16:38:19.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000136778 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.281324+0000", 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030588809999999998 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.288166+0000", 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068423080000000001 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.288213+0000", 2023-07-29T16:38:19.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6186000000000001e-05 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.288247+0000", 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4792999999999997e-05 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:1145 5.6 5:6893acb0:::benchmark_data_smithi070_97781_object1144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.410923+0000", 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3187489640000001, 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011778701000000001, 2023-07-29T16:38:19.790 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1145 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.410923+0000", 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.410923+0000", 2023-07-29T16:38:19.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.410923+0000", 2023-07-29T16:38:19.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411040+0000", 2023-07-29T16:38:19.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116643 2023-07-29T16:38:19.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411045+0000", 2023-07-29T16:38:19.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2449999999999998e-06 2023-07-29T16:38:19.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411049+0000", 2023-07-29T16:38:19.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8199999999999998e-06 2023-07-29T16:38:19.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411077+0000", 2023-07-29T16:38:19.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8251000000000001e-05 2023-07-29T16:38:19.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411183+0000", 2023-07-29T16:38:19.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106307 2023-07-29T16:38:19.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411286+0000", 2023-07-29T16:38:19.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102324 2023-07-29T16:38:19.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.413585+0000", 2023-07-29T16:38:19.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022994000000000001 2023-07-29T16:38:19.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422596+0000", 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090107989999999999 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422636+0000", 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0604e-05 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422702+0000", 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5648000000000006e-05 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1143 5.2 e21/19 5:4f3a5589:::benchmark_data_smithi070_97781_object1142:head v 21'75, mlcod=21'73)", 2023-07-29T16:38:19.806 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411273+0000", 2023-07-29T16:38:19.807 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3183998030000001, 2023-07-29T16:38:19.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011399607000000001, 2023-07-29T16:38:19.807 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.807 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.807 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411273+0000", 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411273+0000", 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411272+0000", 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411451+0000", 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017927700000000001 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411460+0000", 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4160000000000004e-06 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411466+0000", 2023-07-29T16:38:19.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1e-06 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411498+0000", 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2393e-05 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411515+0000", 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7198999999999999e-05 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422619+0000", 2023-07-29T16:38:19.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011103147000000001 2023-07-29T16:38:19.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422672+0000", 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3635999999999999e-05 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.815 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:1147 5.5 5:a0f7d8c4:::benchmark_data_smithi070_97781_object1146:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411290+0000", 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.318382078, 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011476205999999999, 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.816 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1147 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411290+0000", 2023-07-29T16:38:19.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411290+0000", 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411290+0000", 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411522+0000", 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023227799999999999 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411534+0000", 2023-07-29T16:38:19.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1773000000000001e-05 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411539+0000", 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6759999999999998e-06 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411583+0000", 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4623000000000003e-05 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411706+0000", 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122378 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411840+0000", 2023-07-29T16:38:19.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013477399999999999 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.413625+0000", 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017851169999999999 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422669+0000", 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090438740000000004 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422716+0000", 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6978999999999999e-05 2023-07-29T16:38:19.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422766+0000", 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0185000000000001e-05 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.827 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.828 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.828 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1140 5.8 e21/19 5:1baa66f1:::benchmark_data_smithi070_97781_object1139:head v 21'68, mlcod=21'66)", 2023-07-29T16:38:19.828 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411306+0000", 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3183659470000002, 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011332109, 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411306+0000", 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411306+0000", 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411306+0000", 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411455+0000", 2023-07-29T16:38:19.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014849899999999999 2023-07-29T16:38:19.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411461+0000", 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4389999999999997e-06 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411470+0000", 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2250000000000006e-06 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411500+0000", 2023-07-29T16:38:19.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0071999999999999e-05 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411518+0000", 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7473e-05 2023-07-29T16:38:19.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422595+0000", 2023-07-29T16:38:19.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011077050999999999 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422639+0000", 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3687999999999999e-05 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.837 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1142 5.0 e21/19 5:05414990:::benchmark_data_smithi070_97781_object1141:head v 21'82, mlcod=21'79)", 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411479+0000", 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.318193237, 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011257233, 2023-07-29T16:38:19.838 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411479+0000", 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411479+0000", 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411479+0000", 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411564+0000", 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5319000000000001e-05 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411570+0000", 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9100000000000002e-06 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411574+0000", 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.895e-06 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411598+0000", 2023-07-29T16:38:19.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3764000000000002e-05 2023-07-29T16:38:19.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411609+0000", 2023-07-29T16:38:19.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1474999999999999e-05 2023-07-29T16:38:19.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422681+0000", 2023-07-29T16:38:19.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011071647 2023-07-29T16:38:19.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422736+0000", 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5581999999999997e-05 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.848 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1141 5.4 e21/19 5:29ef3715:::benchmark_data_smithi070_97781_object1140:head v 21'82, mlcod=21'80)", 2023-07-29T16:38:19.848 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411582+0000", 2023-07-29T16:38:19.848 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3180900969999998, 2023-07-29T16:38:19.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011106839, 2023-07-29T16:38:19.848 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.849 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.849 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411582+0000", 2023-07-29T16:38:19.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411582+0000", 2023-07-29T16:38:19.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411582+0000", 2023-07-29T16:38:19.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411619+0000", 2023-07-29T16:38:19.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7185999999999999e-05 2023-07-29T16:38:19.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411624+0000", 2023-07-29T16:38:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8890000000000001e-06 2023-07-29T16:38:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411627+0000", 2023-07-29T16:38:19.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2540000000000001e-06 2023-07-29T16:38:19.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411666+0000", 2023-07-29T16:38:19.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8544000000000002e-05 2023-07-29T16:38:19.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411683+0000", 2023-07-29T16:38:19.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6852999999999999e-05 2023-07-29T16:38:19.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422655+0000", 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010972271 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422689+0000", 2023-07-29T16:38:19.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4103000000000002e-05 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.860 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:1151 5.a 5:5e4d12cd:::benchmark_data_smithi070_97781_object1150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411837+0000", 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3178355659999998, 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01092682, 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.861 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1151 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411837+0000", 2023-07-29T16:38:19.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411837+0000", 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411836+0000", 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411946+0000", 2023-07-29T16:38:19.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110182 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411959+0000", 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2636000000000001e-05 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411964+0000", 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0660000000000003e-06 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411996+0000", 2023-07-29T16:38:19.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1841999999999998e-05 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412066+0000", 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0395000000000006e-05 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412143+0000", 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6773000000000005e-05 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.415203+0000", 2023-07-29T16:38:19.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030601740000000001 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422681+0000", 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074781470000000001 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422734+0000", 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2590000000000003e-05 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422764+0000", 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9828999999999999e-05 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1150 5.0 e21/19 5:01546d07:::benchmark_data_smithi070_97781_object1149:head v 21'83, mlcod=21'80)", 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411898+0000", 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3177739060000002, 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010866284, 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.872 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.873 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411898+0000", 2023-07-29T16:38:19.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411898+0000", 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411898+0000", 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412132+0000", 2023-07-29T16:38:19.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023355699999999999 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412138+0000", 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.601e-06 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412143+0000", 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2599999999999996e-06 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412178+0000", 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4635999999999998e-05 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412197+0000", 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8749e-05 2023-07-29T16:38:19.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422739+0000", 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010541877999999999 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422765+0000", 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5979999999999999e-05 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1146 5.2 e21/19 5:4efcca4f:::benchmark_data_smithi070_97781_object1145:head v 21'76, mlcod=21'73)", 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411918+0000", 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3177540670000001, 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010890627, 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.881 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411918+0000", 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411918+0000", 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411918+0000", 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412067+0000", 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014901899999999999 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412073+0000", 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.691e-06 2023-07-29T16:38:19.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412078+0000", 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3800000000000004e-06 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412109+0000", 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0732000000000003e-05 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412126+0000", 2023-07-29T16:38:19.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.753e-05 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422767+0000", 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01064082 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422809+0000", 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1984999999999999e-05 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:1153 5.5 5:a031f3f7:::benchmark_data_smithi070_97781_object1152:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.411976+0000", 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3176959450000001, 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010877360000000001, 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.890 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1153 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411976+0000", 2023-07-29T16:38:19.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411976+0000", 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.411976+0000", 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412095+0000", 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118928 2023-07-29T16:38:19.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412102+0000", 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6939999999999995e-06 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412109+0000", 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8689999999999998e-06 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412155+0000", 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5457000000000002e-05 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412232+0000", 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7383000000000001e-05 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412361+0000", 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129293 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.413649+0000", 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001287865 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422788+0000", 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.009138752 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422830+0000", 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1544000000000001e-05 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422854+0000", 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4155000000000002e-05 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.901 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1148 5.8 e21/19 5:1251f677:::benchmark_data_smithi070_97781_object1147:head v 21'69, mlcod=21'66)", 2023-07-29T16:38:19.902 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.412154+0000", 2023-07-29T16:38:19.902 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3175183480000001, 2023-07-29T16:38:19.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010649502999999999, 2023-07-29T16:38:19.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.903 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412154+0000", 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412154+0000", 2023-07-29T16:38:19.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412154+0000", 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412213+0000", 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9534999999999998e-05 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412220+0000", 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3339999999999996e-06 2023-07-29T16:38:19.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412227+0000", 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4629999999999998e-06 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412258+0000", 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0592000000000001e-05 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412274+0000", 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6699000000000001e-05 2023-07-29T16:38:19.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422766+0000", 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010491973 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422803+0000", 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7298000000000001e-05 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1149 5.2 e21/19 5:4990deda:::benchmark_data_smithi070_97781_object1148:head v 21'77, mlcod=21'73)", 2023-07-29T16:38:19.910 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.412399+0000", 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3172736199999999, 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010431859999999999, 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412399+0000", 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412399+0000", 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412398+0000", 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412447+0000", 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9254e-05 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412454+0000", 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7830000000000001e-06 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412459+0000", 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6619999999999996e-06 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412487+0000", 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8039999999999999e-05 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412498+0000", 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-05 2023-07-29T16:38:19.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422811+0000", 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010312554999999999 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422831+0000", 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9933e-05 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:1152 5.7 e21/19 5:eef856de:::benchmark_data_smithi070_97781_object1151:head v 21'69, mlcod=21'67)", 2023-07-29T16:38:19.918 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.412476+0000", 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3171963770000001, 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010336992, 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412476+0000", 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412476+0000", 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412476+0000", 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412526+0000", 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0460999999999997e-05 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412531+0000", 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440000000000002e-06 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412536+0000", 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.006e-06 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412568+0000", 2023-07-29T16:38:19.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1628000000000003e-05 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.412581+0000", 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2959000000000001e-05 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422780+0000", 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010198988000000001 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.422813+0000", 2023-07-29T16:38:19.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3167999999999998e-05 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:3504 5.c 5:35eebcdf:::benchmark_data_smithi070_97781_object3503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.919025+0000", 2023-07-29T16:38:19.926 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.810647162, 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01204567, 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 3504 2023-07-29T16:38:19.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919025+0000", 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919025+0000", 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919024+0000", 2023-07-29T16:38:19.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919150+0000", 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125277 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919157+0000", 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5750000000000003e-06 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919163+0000", 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8159999999999999e-06 2023-07-29T16:38:19.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919205+0000", 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2191000000000003e-05 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919331+0000", 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125673 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.919466+0000", 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013510099999999999 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921210+0000", 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017437970000000001 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931010+0000", 2023-07-29T16:38:19.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098005139999999998 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931039+0000", 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8839999999999998e-05 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931071+0000", 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1676e-05 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:3518 5.c 5:3a7556c6:::benchmark_data_smithi070_97781_object3517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:16.921496+0000", 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.8081765829999998, 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096769500000000001, 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 3518 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921496+0000", 2023-07-29T16:38:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921496+0000", 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921495+0000", 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921544+0000", 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9066000000000001e-05 2023-07-29T16:38:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921566+0000", 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1489999999999999e-05 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921574+0000", 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9140000000000008e-06 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921605+0000", 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0929000000000002e-05 2023-07-29T16:38:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921688+0000", 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3096000000000005e-05 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:19.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.921815+0000", 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012744000000000001 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.922879+0000", 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010636599999999999 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931101+0000", 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082219839999999999 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931151+0000", 2023-07-29T16:38:19.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.02e-05 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:16.931173+0000", 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1739999999999999e-05 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:19.947 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:19.947 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:19.948 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:19.949 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:19.945+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:20.048 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:20.046+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:20.074 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 4 16 15057 15041 234.999 200.375 0.00571399 0.00425144 2023-07-29T16:38:20.116 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15169 5.e 5:76e91f6a:::benchmark_data_smithi070_97781_object15168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.112323+0000", 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0013499300000000001, 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001378443, 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15169 2023-07-29T16:38:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112323+0000", 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112323+0000", 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112322+0000", 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112396+0000", 2023-07-29T16:38:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3984000000000002e-05 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112402+0000", 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1319999999999999e-06 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112407+0000", 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.498e-06 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113091+0000", 2023-07-29T16:38:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00068436400000000002 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113192+0000", 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010091599999999999 2023-07-29T16:38:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113272+0000", 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9764000000000004e-05 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:15164 5.f e23/19 5:f670d994:::benchmark_data_smithi070_97781_object15163:head v 23'949, mlcod=23'946)", 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.112868+0000", 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00080416099999999996, 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092258200000000002, 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112868+0000", 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112868+0000", 2023-07-29T16:38:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112868+0000", 2023-07-29T16:38:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112932+0000", 2023-07-29T16:38:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3950999999999998e-05 2023-07-29T16:38:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112939+0000", 2023-07-29T16:38:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3370000000000002e-06 2023-07-29T16:38:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112945+0000", 2023-07-29T16:38:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6459999999999998e-06 2023-07-29T16:38:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112982+0000", 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7317999999999997e-05 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113004+0000", 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1806000000000001e-05 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15170 5.8 5:196b60db:::benchmark_data_smithi070_97781_object15169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.113412+0000", 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000260191, 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046718299999999998, 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15170 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113412+0000", 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113412+0000", 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113412+0000", 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113500+0000", 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8242e-05 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113511+0000", 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0596e-05 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113518+0000", 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7680000000000008e-06 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113557+0000", 2023-07-29T16:38:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8658000000000002e-05 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113655+0000", 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7873000000000003e-05 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113764+0000", 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109052 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15156 5.d 5:b0342ad3:::benchmark_data_smithi070_97781_object15155:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.109207+0000", 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0044660330000000003, 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047473849999999998, 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15156 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109207+0000", 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109207+0000", 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109206+0000", 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109310+0000", 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103628 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109318+0000", 2023-07-29T16:38:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0099999999999995e-06 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109325+0000", 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.827e-06 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109369+0000", 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4705e-05 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109504+0000", 2023-07-29T16:38:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013428299999999999 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.109646+0000", 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142624 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112285+0000", 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026384429999999999 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15163 5.d 5:b1af9484:::benchmark_data_smithi070_97781_object15162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.111213+0000", 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0024598850000000002, 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028013449999999998, 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15163 2023-07-29T16:38:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111213+0000", 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111213+0000", 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111212+0000", 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111273+0000", 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1246000000000003e-05 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111282+0000", 2023-07-29T16:38:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3820000000000004e-06 2023-07-29T16:38:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111287+0000", 2023-07-29T16:38:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0780000000000003e-06 2023-07-29T16:38:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111400+0000", 2023-07-29T16:38:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113613 2023-07-29T16:38:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111532+0000", 2023-07-29T16:38:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013199500000000001 2023-07-29T16:38:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111706+0000", 2023-07-29T16:38:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017407600000000001 2023-07-29T16:38:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113343+0000", 2023-07-29T16:38:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016368400000000001 2023-07-29T16:38:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15165 5.d 5:b1eec66b:::benchmark_data_smithi070_97781_object15164:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.111631+0000", 2023-07-29T16:38:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00204155, 2023-07-29T16:38:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024271369999999998, 2023-07-29T16:38:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15165 2023-07-29T16:38:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111631+0000", 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111631+0000", 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111630+0000", 2023-07-29T16:38:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111772+0000", 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141853 2023-07-29T16:38:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111780+0000", 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9950000000000005e-06 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111787+0000", 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6510000000000004e-06 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112309+0000", 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052201099999999996 2023-07-29T16:38:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112425+0000", 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011626 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112563+0000", 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013842600000000001 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113742+0000", 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011783659999999999 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15167 5.e 5:77524785:::benchmark_data_smithi070_97781_object15166:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.111910+0000", 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0017622099999999999, 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021939860000000002, 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15167 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111910+0000", 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111910+0000", 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.111910+0000", 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112080+0000", 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017009800000000001 2023-07-29T16:38:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112089+0000", 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8480000000000007e-06 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112099+0000", 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0674e-05 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112152+0000", 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2358999999999998e-05 2023-07-29T16:38:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112273+0000", 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121206 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.112413+0000", 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014014100000000001 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.113755+0000", 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013420719999999999 2023-07-29T16:38:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:38:20.186 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:20.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:20.189 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:20.185+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:20.288 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:20.286+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:20.388 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:20.386+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:20.399 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:20.400 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:20.400 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:20.400 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:20.400 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:20.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2023-07-29T16:38:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:38:20.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-07-29T16:38:20.489 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:20.487+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:20.590 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:20.588+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:20.622 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:20.622 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:20.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.671135996, 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:20.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:20.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:20.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:20.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:20.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670835011000001, 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:20.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:20.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:20.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:20.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670802256999998, 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.647 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:20.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:20.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:20.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:20.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:20.658 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670771376000001, 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:20.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:20.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:20.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:20.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:20.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.669 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670750005999999, 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:20.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:20.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:20.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670715560000001, 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.681 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670693882999998, 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670215505000002, 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.670176185999999, 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012841247, 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948282+0000", 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948292+0000", 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1570000000000006e-06 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948300+0000", 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3189999999999995e-06 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948961+0000", 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066065600000000003 2023-07-29T16:38:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948982+0000", 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1588999999999999e-05 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953445+0000", 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044624970000000002 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953666+0000", 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022092699999999999 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961112+0000", 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074460000000000004 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:1140 5.8 5:1baa66f1:::benchmark_data_smithi070_97781_object1139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:16.410960+0000", 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2074862829999997, 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011924799, 2023-07-29T16:38:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1140 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.410960+0000", 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.410960+0000", 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.410960+0000", 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.410991+0000", 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1458999999999998e-05 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411006+0000", 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5126999999999999e-05 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411014+0000", 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0849999999999997e-06 2023-07-29T16:38:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411047+0000", 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3114999999999997e-05 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411168+0000", 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012029299999999999 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411285+0000", 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117089 2023-07-29T16:38:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.412302+0000", 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001017172 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422829+0000", 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010526482 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422858+0000", 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9118000000000001e-05 2023-07-29T16:38:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422885+0000", 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7440000000000002e-05 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:1141 5.4 5:29ef3715:::benchmark_data_smithi070_97781_object1140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:16.411024+0000", 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2074226860000001, 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011912407, 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1141 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411024+0000", 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411024+0000", 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411023+0000", 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411074+0000", 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1022e-05 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411082+0000", 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411088+0000", 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4620000000000004e-06 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411127+0000", 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9863000000000001e-05 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411250+0000", 2023-07-29T16:38:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122368 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411379+0000", 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012872900000000001 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.412125+0000", 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074610599999999996 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422860+0000", 2023-07-29T16:38:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010735707000000001 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422902+0000", 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2126999999999998e-05 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422936+0000", 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3784e-05 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:1142 5.0 5:05414990:::benchmark_data_smithi070_97781_object1141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:16.411097+0000", 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2073496869999998, 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011843846999999999, 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1142 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411097+0000", 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411097+0000", 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411096+0000", 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411128+0000", 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1347000000000003e-05 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411137+0000", 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8869999999999998e-06 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411143+0000", 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2023-07-29T16:38:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411170+0000", 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7545000000000001e-05 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411246+0000", 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.572e-05 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411346+0000", 2023-07-29T16:38:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100114 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.412440+0000", 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010938460000000001 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422873+0000", 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010432853000000001 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422912+0000", 2023-07-29T16:38:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9473e-05 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422941+0000", 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8538999999999999e-05 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:1148 5.8 5:1251f677:::benchmark_data_smithi070_97781_object1147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:16.411605+0000", 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.206841743, 2023-07-29T16:38:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011436326, 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1148 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411605+0000", 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411605+0000", 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411604+0000", 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411638+0000", 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3886e-05 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411648+0000", 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0468999999999999e-05 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411654+0000", 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9490000000000001e-06 2023-07-29T16:38:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411693+0000", 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8571000000000001e-05 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411796+0000", 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103811 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411902+0000", 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105338 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.412787+0000", 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088508800000000002 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422975+0000", 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010187695 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.423012+0000", 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7511000000000001e-05 2023-07-29T16:38:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.423041+0000", 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9003999999999999e-05 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:1150 5.0 5:01546d07:::benchmark_data_smithi070_97781_object1149:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:16.411662+0000", 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.206784882, 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011376842, 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1150 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411662+0000", 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411662+0000", 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411661+0000", 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411688+0000", 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6755999999999999e-05 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411695+0000", 2023-07-29T16:38:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4200000000000001e-06 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411701+0000", 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479999999999997e-06 2023-07-29T16:38:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411723+0000", 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2796999999999999e-05 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411802+0000", 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8225000000000004e-05 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.411883+0000", 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1303000000000004e-05 2023-07-29T16:38:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.412783+0000", 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000899664 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.422981+0000", 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198766999999999 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.423008+0000", 2023-07-29T16:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6441e-05 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:16.423039+0000", 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0790000000000002e-05 2023-07-29T16:38:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:13852 5.8 5:16d6f262:::benchmark_data_smithi070_97781_object13851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:19.694983+0000", 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.92346352700000001, 2023-07-29T16:38:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010900712, 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13852 2023-07-29T16:38:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.694983+0000", 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.694983+0000", 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.694982+0000", 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695040+0000", 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7556000000000003e-05 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695048+0000", 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1070000000000005e-06 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695054+0000", 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0419999999999999e-06 2023-07-29T16:38:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695767+0000", 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071311699999999998 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695910+0000", 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014319100000000001 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.696042+0000", 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013140100000000001 2023-07-29T16:38:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.697857+0000", 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001815465 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705796+0000", 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079386439999999999 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705847+0000", 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0739000000000003e-05 2023-07-29T16:38:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705884+0000", 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7116999999999997e-05 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:13854 5.b 5:d4c37461:::benchmark_data_smithi070_97781_object13853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:19.695115+0000", 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.92333152200000002, 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010775356999999999, 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13854 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695115+0000", 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695115+0000", 2023-07-29T16:38:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695114+0000", 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695165+0000", 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0133000000000003e-05 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695171+0000", 2023-07-29T16:38:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8870000000000003e-06 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695177+0000", 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9320000000000001e-06 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695620+0000", 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044271799999999999 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695767+0000", 2023-07-29T16:38:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014682000000000001 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.695892+0000", 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012525700000000001 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.697843+0000", 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019506339999999999 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705812+0000", 2023-07-29T16:38:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079687930000000001 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705850+0000", 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8383000000000002e-05 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:19.705890+0000", 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0343999999999999e-05 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15911 5.0 5:06027f99:::benchmark_data_smithi070_97781_object15910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.27669995200000003, 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012899693, 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15911 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341746+0000", 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341786+0000", 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0212000000000001e-05 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341798+0000", 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1574e-05 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341804+0000", 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8589999999999999e-06 2023-07-29T16:38:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341853+0000", 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8674999999999997e-05 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341975+0000", 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012234999999999999 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342129+0000", 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153647 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343867+0000", 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017379629999999999 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354539+0000", 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010671579 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354603+0000", 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4343000000000004e-05 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354646+0000", 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3297000000000002e-05 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15912 5.4 5:2fd85949:::benchmark_data_smithi070_97781_object15911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.342372+0000", 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.27607487200000003, 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012441410999999999, 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15912 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342372+0000", 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342372+0000", 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342371+0000", 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342456+0000", 2023-07-29T16:38:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4906000000000003e-05 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342466+0000", 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6830000000000003e-06 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342473+0000", 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0219999999999999e-06 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342538+0000", 2023-07-29T16:38:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5690000000000003e-05 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342695+0000", 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000156508 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342837+0000", 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142208 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.344651+0000", 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00181448 2023-07-29T16:38:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354730+0000", 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010078714000000001 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354777+0000", 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7203999999999997e-05 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354813+0000", 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5707000000000002e-05 2023-07-29T16:38:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15915 5.b 5:dfe3b182:::benchmark_data_smithi070_97781_object15914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.343125+0000", 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.275322022, 2023-07-29T16:38:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011489149000000001, 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15915 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343125+0000", 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343125+0000", 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343124+0000", 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343187+0000", 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3404999999999993e-05 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343194+0000", 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9029999999999998e-06 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343199+0000", 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9200000000000003e-06 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343226+0000", 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7007000000000001e-05 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343315+0000", 2023-07-29T16:38:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9080999999999996e-05 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343410+0000", 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4899000000000001e-05 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.345351+0000", 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00194144 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354541+0000", 2023-07-29T16:38:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091893949999999995 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354573+0000", 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1791000000000001e-05 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354614+0000", 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0995999999999998e-05 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:16129 5.0 5:0b99b83d:::benchmark_data_smithi070_97781_object16128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.419738+0000", 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.198708732, 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011365424000000001, 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 16129 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419738+0000", 2023-07-29T16:38:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419738+0000", 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419737+0000", 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419806+0000", 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8967999999999994e-05 2023-07-29T16:38:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419816+0000", 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4660000000000005e-06 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.419822+0000", 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.562e-06 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.420115+0000", 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029245699999999998 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.420250+0000", 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013535000000000001 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.420361+0000", 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111224 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.426020+0000", 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056593199999999998 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.431046+0000", 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050252420000000001 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.431074+0000", 2023-07-29T16:38:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974999999999999e-05 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.431103+0000", 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9533999999999999e-05 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:20.841 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:20.842 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:20.843 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:20.840+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:20.943 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:20.941+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:21.019 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:21.019 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:21.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.019 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:18027 5.f 5:fefc39cb:::benchmark_data_smithi070_97781_object18026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.008151+0000", 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0085986659999999996, 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0086286669999999996, 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 18027 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008151+0000", 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008151+0000", 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008151+0000", 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008179+0000", 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8555e-05 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008184+0000", 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8339999999999998e-06 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.008188+0000", 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4800000000000001e-06 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010515+0000", 2023-07-29T16:38:21.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023274049999999998 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010595+0000", 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0177000000000002e-05 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010673+0000", 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7871e-05 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013613+0000", 2023-07-29T16:38:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029398789999999998 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016699+0000", 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030859049999999999 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016745+0000", 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5753000000000001e-05 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016780+0000", 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:18033 5.7 5:eec6d7a0:::benchmark_data_smithi070_97781_object18032:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.010935+0000", 2023-07-29T16:38:21.030 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0058146839999999997, 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059543510000000001, 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 18033 2023-07-29T16:38:21.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010935+0000", 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010935+0000", 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.010935+0000", 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.011020+0000", 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5395999999999994e-05 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.011030+0000", 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9070000000000002e-06 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.011035+0000", 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.502e-06 2023-07-29T16:38:21.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013599+0000", 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002563241 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013694+0000", 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5804999999999995e-05 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013784+0000", 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9444000000000006e-05 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.037 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:18037 5.c e24/19 5:324bb7b7:::benchmark_data_smithi070_97781_object18036:head v 24'1159, mlcod=24'1155)", 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.013057+0000", 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0036932219999999999, 2023-07-29T16:38:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038861820000000002, 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013057+0000", 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013057+0000", 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013056+0000", 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013114+0000", 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7846999999999997e-05 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013120+0000", 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0390000000000001e-06 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013124+0000", 2023-07-29T16:38:21.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.856e-06 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013777+0000", 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00065341900000000003 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.013795+0000", 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8121000000000001e-05 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:18040 5.c e24/19 5:33093a78:::benchmark_data_smithi070_97781_object18039:head v 24'1160, mlcod=24'1155)", 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.014078+0000", 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0026720310000000001, 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029075350000000002, 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014078+0000", 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014078+0000", 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014077+0000", 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014139+0000", 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2065999999999998e-05 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014150+0000", 2023-07-29T16:38:21.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0728e-05 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014157+0000", 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8839999999999997e-06 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014443+0000", 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00028576699999999998 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014454+0000", 2023-07-29T16:38:21.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1667e-05 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:18038 5.6 e24/19 5:6cd71049:::benchmark_data_smithi070_97781_object18037:head v 24'1080, mlcod=24'1076)", 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.014193+0000", 2023-07-29T16:38:21.051 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0025565430000000001, 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028279239999999999, 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014193+0000", 2023-07-29T16:38:21.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014193+0000", 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014193+0000", 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014271+0000", 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8349000000000005e-05 2023-07-29T16:38:21.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014280+0000", 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5590000000000006e-06 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014286+0000", 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2469999999999997e-06 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014319+0000", 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3336000000000001e-05 2023-07-29T16:38:21.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014331+0000", 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1676e-05 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:18043 5.9 5:955480db:::benchmark_data_smithi070_97781_object18042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.014720+0000", 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0020298410000000001, 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002336472, 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.058 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 18043 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014720+0000", 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014720+0000", 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014719+0000", 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014780+0000", 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0628999999999998e-05 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014797+0000", 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7604e-05 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014808+0000", 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.099e-05 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014844+0000", 2023-07-29T16:38:21.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5571999999999998e-05 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.014933+0000", 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8865999999999999e-05 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015017+0000", 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4635000000000005e-05 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:18044 5.7 5:e9142c68:::benchmark_data_smithi070_97781_object18043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.015042+0000", 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0017077290000000001, 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020576190000000001, 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 18044 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015042+0000", 2023-07-29T16:38:21.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015042+0000", 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015042+0000", 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015102+0000", 2023-07-29T16:38:21.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0324e-05 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015109+0000", 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9079999999999998e-06 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015115+0000", 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8619999999999999e-06 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015161+0000", 2023-07-29T16:38:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6657999999999999e-05 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015285+0000", 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012401299999999999 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015422+0000", 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000136699 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.073 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:18041 5.6 e24/19 5:61ce412a:::benchmark_data_smithi070_97781_object18040:head v 24'1081, mlcod=24'1077)", 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.015272+0000", 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0014774129999999999, 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001869604, 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015272+0000", 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015272+0000", 2023-07-29T16:38:21.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015272+0000", 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015332+0000", 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0109999999999999e-05 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015338+0000", 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9560000000000002e-06 2023-07-29T16:38:21.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015342+0000", 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9360000000000001e-06 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015374+0000", 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1760000000000001e-05 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.015391+0000", 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7544e-05 2023-07-29T16:38:21.079 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:18046 5.7 5.3bd61167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:21.016948+0000", 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9998016, 2023-07-29T16:38:21.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000246543, 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 18046 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.081 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016948+0000", 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016948+0000", 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.016948+0000", 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.017154+0000", 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020629599999999999 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.017162+0000", 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3669999999999997e-06 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.017168+0000", 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1089999999999997e-06 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.017192+0000", 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4672e-05 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.086 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:21.087 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:38:21.087 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:21.088 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 5 16 18195 18179 227.22 196.125 0.00591529 0.00439551 2023-07-29T16:38:21.088 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:21.086+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:21.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:21.188 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:21.187+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:21.256 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:21.257 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:21.257 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:21.257 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:21.257 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:21.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:21.316 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:21.315+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:21.391 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:21.388+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:21.442 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:21.443 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 38.917320967000002, 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:21.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:21.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:21.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:21.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:21.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:21.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:21.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:21.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:21.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:21.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:21.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:21.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:21.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:21.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.458 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.459 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.459 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492437802000001, 2023-07-29T16:38:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015080049999999999, 2023-07-29T16:38:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946369+0000", 2023-07-29T16:38:21.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946378+0000", 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8060000000000001e-06 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946389+0000", 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1250000000000001e-05 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946402+0000", 2023-07-29T16:38:21.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2143e-05 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948774+0000", 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023720920000000001 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948780+0000", 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8680000000000004e-06 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952342+0000", 2023-07-29T16:38:21.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035620199999999999 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952751+0000", 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040939399999999999 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952906+0000", 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000154776 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958270+0000", 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053643049999999998 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961358+0000", 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030884549999999999 2023-07-29T16:38:21.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961411+0000", 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2608999999999997e-05 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961451+0000", 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9889999999999999e-05 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.471 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492391915999999, 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015461422000000001, 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:21.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946416+0000", 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946421+0000", 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7140000000000001e-06 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946428+0000", 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2660000000000004e-06 2023-07-29T16:38:21.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946438+0000", 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0284e-05 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949297+0000", 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028585070000000001 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949308+0000", 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1445e-05 2023-07-29T16:38:21.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953255+0000", 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039465510000000004 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953337+0000", 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1692000000000003e-05 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953490+0000", 2023-07-29T16:38:21.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015321900000000001 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958277+0000", 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047871550000000004 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961774+0000", 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00349672 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961837+0000", 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2967999999999997e-05 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961878+0000", 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1591000000000002e-05 2023-07-29T16:38:21.482 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:21.483 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492363986000001, 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:21.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:21.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:21.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:21.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:21.494 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:21.495 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492339131000001, 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:21.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:21.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:21.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492307187000002, 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.507 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:21.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:21.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:21.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:21.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:21.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:21.518 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492285576, 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:21.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:21.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:21.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492261515999999, 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.530 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:21.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:21.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.541 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492226368000001, 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:21.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:21.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:21.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:21.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:21.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:21.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:21.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492190254, 2023-07-29T16:38:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:21.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:21.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:21.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:21.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:21.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:21.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:21.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492165351000001, 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.608 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:21.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:21.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:21.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492131902000001, 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013415086, 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.620 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946677+0000", 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946676+0000", 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946680+0000", 2023-07-29T16:38:21.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1810000000000003e-06 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946688+0000", 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946694+0000", 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0739999999999998e-06 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947354+0000", 2023-07-29T16:38:21.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00066083699999999995 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947362+0000", 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7249999999999997e-06 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954538+0000", 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0071760249999999999 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954651+0000", 2023-07-29T16:38:21.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112422 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954775+0000", 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012481999999999999 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957415+0000", 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026398070000000001 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959812+0000", 2023-07-29T16:38:21.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023968879999999998 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959860+0000", 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8276999999999999e-05 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960092+0000", 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00023148799999999999 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492110378, 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.632 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:21.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492043061, 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.644 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:21.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:21.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:21.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:21.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:21.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:21.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:21.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:21.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:21.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:21.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:21.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:21.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:21.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:21.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:21.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:21.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:21.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:21.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.658 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.659 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.660 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:21.660 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.492018141999999, 2023-07-29T16:38:21.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:21.660 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.660 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.661 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:21.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:21.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:21.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:21.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:21.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:21.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:21.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.491966599000001, 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:21.673 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:21.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:21.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.491942650999999, 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016589201000000001, 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946869+0000", 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946880+0000", 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0614e-05 2023-07-29T16:38:21.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946885+0000", 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6469999999999997e-06 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948666+0000", 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001781384 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948670+0000", 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9720000000000003e-06 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954685+0000", 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060152510000000001 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954828+0000", 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014298100000000001 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:21.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955312+0000", 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048344000000000002 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958247+0000", 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029349749999999998 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963305+0000", 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050582989999999996 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963411+0000", 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106001 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963455+0000", 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4478999999999999e-05 2023-07-29T16:38:21.696 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.491919015000001, 2023-07-29T16:38:21.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:21.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:21.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:21.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:21.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.491895728999999, 2023-07-29T16:38:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:21.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:21.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:21.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:21.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:21.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:21.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:21.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:21.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:21.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:21.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:21.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:21.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:21.720 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:17991 5.f 5:f324611d:::benchmark_data_smithi070_97781_object17990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:20.994057+0000", 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.44475205299999998, 2023-07-29T16:38:21.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013142245, 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 17991 2023-07-29T16:38:21.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994057+0000", 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994057+0000", 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994056+0000", 2023-07-29T16:38:21.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994121+0000", 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5099999999999997e-05 2023-07-29T16:38:21.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994131+0000", 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7070000000000004e-06 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994138+0000", 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9229999999999996e-06 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994172+0000", 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3796e-05 2023-07-29T16:38:21.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994271+0000", 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9056999999999997e-05 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.994382+0000", 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011124 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:20.996337+0000", 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019550169999999999 2023-07-29T16:38:21.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.007149+0000", 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010812519 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:21.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.007178+0000", 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8952e-05 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:21.007199+0000", 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0625e-05 2023-07-29T16:38:21.731 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:21.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:21.732 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:21.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:21.734 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:21.730+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:21.735 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2023-07-29T16:38:21.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:21.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-07-29T16:38:21.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:21.835 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:21.833+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:21.919 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:21.919 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:21.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.920 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:20699 5.c 5:3e3e0f5e:::benchmark_data_smithi070_97781_object20698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:21.920 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.912855+0000", 2023-07-29T16:38:21.920 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003805409, 2023-07-29T16:38:21.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038263080000000001, 2023-07-29T16:38:21.920 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 20699 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.921 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912855+0000", 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912855+0000", 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912854+0000", 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:21.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912889+0000", 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4644000000000002e-05 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912900+0000", 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1255e-05 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912908+0000", 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9820000000000008e-06 2023-07-29T16:38:21.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912943+0000", 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5150000000000001e-05 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.913130+0000", 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018697000000000001 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:21.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.913290+0000", 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015988800000000001 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916345+0000", 2023-07-29T16:38:21.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030552510000000001 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.929 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:20700 5.c 5:3fe6d3ad:::benchmark_data_smithi070_97781_object20699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.912919+0000", 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003741416, 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038168350000000002, 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:21.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:21.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.931 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 20700 2023-07-29T16:38:21.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.931 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912919+0000", 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912919+0000", 2023-07-29T16:38:21.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912918+0000", 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912946+0000", 2023-07-29T16:38:21.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7977999999999999e-05 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912954+0000", 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.503e-06 2023-07-29T16:38:21.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.912965+0000", 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.149e-05 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914132+0000", 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00116672 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914269+0000", 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013685600000000001 2023-07-29T16:38:21.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914394+0000", 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124669 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20701 5.e e25/19 5:7049c1e1:::benchmark_data_smithi070_97781_object20700:head v 25'1254, mlcod=25'1251)", 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.914199+0000", 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024617010000000002, 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002582647, 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.939 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914199+0000", 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914199+0000", 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914198+0000", 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914279+0000", 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0338000000000002e-05 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914289+0000", 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.092e-05 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914306+0000", 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6999000000000001e-05 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914337+0000", 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0793000000000001e-05 2023-07-29T16:38:21.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914350+0000", 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2271e-05 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20703 5.2 e25/19 5:44aea982:::benchmark_data_smithi070_97781_object20702:head v 25'1313, mlcod=25'1309)", 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.914605+0000", 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020552600000000002, 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022109899999999999, 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.946 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914605+0000", 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914605+0000", 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914605+0000", 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914660+0000", 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4873999999999997e-05 2023-07-29T16:38:21.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914667+0000", 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5100000000000001e-06 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914673+0000", 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000004e-06 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914717+0000", 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3887999999999997e-05 2023-07-29T16:38:21.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914737+0000", 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0451000000000001e-05 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.952 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20702 5.8 e25/19 5:14b90b19:::benchmark_data_smithi070_97781_object20701:head v 25'1299, mlcod=25'1296)", 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.914685+0000", 2023-07-29T16:38:21.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001975091, 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021659280000000001, 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914685+0000", 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914685+0000", 2023-07-29T16:38:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914685+0000", 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914727+0000", 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1794e-05 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914736+0000", 2023-07-29T16:38:21.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8539999999999992e-06 2023-07-29T16:38:21.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914743+0000", 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5379999999999999e-06 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914784+0000", 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0818999999999997e-05 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914800+0000", 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6628000000000001e-05 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:20705 5.6 5:6a45c922:::benchmark_data_smithi070_97781_object20704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:21.961 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.914795+0000", 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001865701, 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020924960000000001, 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:21.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 20705 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914795+0000", 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914795+0000", 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914794+0000", 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914927+0000", 2023-07-29T16:38:21.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133592 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914939+0000", 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1814000000000001e-05 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914948+0000", 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4440000000000008e-06 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.914986+0000", 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8186999999999999e-05 2023-07-29T16:38:21.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915111+0000", 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125003 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915265+0000", 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015450500000000001 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:20706 5.c 5:37a98d51:::benchmark_data_smithi070_97781_object20705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.915178+0000", 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014826539999999999, 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017532209999999999, 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:21.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:21.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.971 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 20706 2023-07-29T16:38:21.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.971 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915178+0000", 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915178+0000", 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915177+0000", 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:21.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915227+0000", 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9589999999999998e-05 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915237+0000", 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0079e-05 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915244+0000", 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3069999999999997e-06 2023-07-29T16:38:21.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915294+0000", 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0303000000000003e-05 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915443+0000", 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014824900000000001 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915562+0000", 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119293 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:20708 5.a 5:5d623a5f:::benchmark_data_smithi070_97781_object20707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.915533+0000", 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0011271040000000001, 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014736700000000001, 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 20708 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915533+0000", 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915533+0000", 2023-07-29T16:38:21.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915533+0000", 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915622+0000", 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9913000000000005e-05 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915637+0000", 2023-07-29T16:38:21.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4583000000000001e-05 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915645+0000", 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5809999999999999e-06 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915688+0000", 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3387999999999999e-05 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915812+0000", 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012403699999999999 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915942+0000", 2023-07-29T16:38:21.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129708 2023-07-29T16:38:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20704 5.8 e25/19 5:1f52c021:::benchmark_data_smithi070_97781_object20703:head v 25'1300, mlcod=25'1296)", 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.915573+0000", 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001087057, 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015029360000000001, 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.988 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:21.989 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915573+0000", 2023-07-29T16:38:21.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915573+0000", 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915573+0000", 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915686+0000", 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112664 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915693+0000", 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4889999999999998e-06 2023-07-29T16:38:21.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915699+0000", 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7389999999999996e-06 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915728+0000", 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9496999999999999e-05 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915744+0000", 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6078000000000001e-05 2023-07-29T16:38:21.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20707 5.e e25/19 5:7c1abdcd:::benchmark_data_smithi070_97781_object20706:head v 25'1255, mlcod=25'1252)", 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.915709+0000", 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00095142200000000005, 2023-07-29T16:38:21.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014103849999999999, 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915709+0000", 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915709+0000", 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915709+0000", 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915739+0000", 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0673999999999998e-05 2023-07-29T16:38:21.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915746+0000", 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6989999999999997e-06 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:21.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915751+0000", 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8219999999999997e-06 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915802+0000", 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1564000000000003e-05 2023-07-29T16:38:22.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.915820+0000", 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7804000000000001e-05 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:22.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20710 5.8 e25/19 5:102e7297:::benchmark_data_smithi070_97781_object20709:head v 25'1301, mlcod=25'1297)", 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.916819+0000", 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998412, 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033413699999999998, 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:22.002 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916819+0000", 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916819+0000", 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916819+0000", 2023-07-29T16:38:22.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916913+0000", 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4643999999999997e-05 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916924+0000", 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916931+0000", 2023-07-29T16:38:22.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3420000000000002e-06 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916972+0000", 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1164000000000001e-05 2023-07-29T16:38:22.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916997+0000", 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4318999999999999e-05 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.009 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:20711 5.7 e25/19 5:e5299a67:::benchmark_data_smithi070_97781_object20710:head v 25'1258, mlcod=25'1255)", 2023-07-29T16:38:22.009 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:21.916838+0000", 2023-07-29T16:38:22.009 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998226, 2023-07-29T16:38:22.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035438700000000001, 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916838+0000", 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:22.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916838+0000", 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916837+0000", 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916937+0000", 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100146 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916946+0000", 2023-07-29T16:38:22.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916951+0000", 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5609999999999998e-06 2023-07-29T16:38:22.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.916999+0000", 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7960000000000002e-05 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:22.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:22.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:22.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:21.917012+0000", 2023-07-29T16:38:22.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2848e-05 2023-07-29T16:38:22.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:22.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:22.017 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:22.017 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2023-07-29T16:38:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:22.019 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:22.017+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:22.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:22.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:22.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:22.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:22.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:22.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:22.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:22.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 6 16 21160 21144 220.233 185.312 0.00610665 0.00453671 2023-07-29T16:38:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:22.124 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:22.121+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:22.133 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-29T16:38:21.465664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1075645274,"num_objects":16428,"num_object_clones":0,"num_object_copies":32856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16428,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":16652,"num_write_kb":1053330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16600,"ondisk_log_size":16600,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":205040,"kb_used_data":115992,"kb_used_omap":0,"kb_used_meta":89024,"kb_avail":282910480,"statfs":{"total":289910292480,"available":289700331520,"internally_reserved":0,"allocated":118775808,"data_stored":1888531727,"data_compressed":9039532,"data_compressed_allocated":118018048,"data_compressed_original":1888256000,"omap_allocated":0,"internal_metadata":91160576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.467129"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431398+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:38:19.431398+0000","last_peered":"2023-07-29T16:38:19.431398+0000","last_clean":"2023-07-29T16:38:19.431398+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:38:19.431398+0000","last_undegraded":"2023-07-29T16:38:19.431398+0000","last_fullsized":"2023-07-29T16:38:19.431398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431256+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:38:19.431256+0000","last_peered":"2023-07-29T16:38:19.431256+0000","last_clean":"2023-07-29T16:38:19.431256+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:38:19.431256+0000","last_undegraded":"2023-07-29T16:38:19.431256+0000","last_fullsized":"2023-07-29T16:38:19.431256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438098+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:38:19.438098+0000","last_peered":"2023-07-29T16:38:19.438098+0000","last_clean":"2023-07-29T16:38:19.438098+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:38:19.438098+0000","last_undegraded":"2023-07-29T16:38:19.438098+0000","last_fullsized":"2023-07-29T16:38:19.438098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437879+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:38:19.437879+0000","last_peered":"2023-07-29T16:38:19.437879+0000","last_clean":"2023-07-29T16:38:19.437879+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:38:19.437879+0000","last_undegraded":"2023-07-29T16:38:19.437879+0000","last_fullsized":"2023-07-29T16:38:19.437879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430777+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:38:19.430777+0000","last_peered":"2023-07-29T16:38:19.430777+0000","last_clean":"2023-07-29T16:38:19.430777+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:38:19.430777+0000","last_undegraded":"2023-07-29T16:38:19.430777+0000","last_fullsized":"2023-07-29T16:38:19.430777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437461+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:38:19.437461+0000","last_peered":"2023-07-29T16:38:19.437461+0000","last_clean":"2023-07-29T16:38:19.437461+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:38:19.437461+0000","last_undegraded":"2023-07-29T16:38:19.437461+0000","last_fullsized":"2023-07-29T16:38:19.437461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437532+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:38:19.437532+0000","last_peered":"2023-07-29T16:38:19.437532+0000","last_clean":"2023-07-29T16:38:19.437532+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:38:19.437532+0000","last_undegraded":"2023-07-29T16:38:19.437532+0000","last_fullsized":"2023-07-29T16:38:19.437532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436968+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:38:19.436968+0000","last_peered":"2023-07-29T16:38:19.436968+0000","last_clean":"2023-07-29T16:38:19.436968+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:38:19.436968+0000","last_undegraded":"2023-07-29T16:38:19.436968+0000","last_fullsized":"2023-07-29T16:38:19.436968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434569+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:38:19.434569+0000","last_peered":"2023-07-29T16:38:19.434569+0000","last_clean":"2023-07-29T16:38:19.434569+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:38:19.434569+0000","last_undegraded":"2023-07-29T16:38:19.434569+0000","last_fullsized":"2023-07-29T16:38:19.434569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431427+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:38:19.431427+0000","last_peered":"2023-07-29T16:38:19.431427+0000","last_clean":"2023-07-29T16:38:19.431427+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:38:19.431427+0000","last_undegraded":"2023-07-29T16:38:19.431427+0000","last_fullsized":"2023-07-29T16:38:19.431427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438016+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:38:19.438016+0000","last_peered":"2023-07-29T16:38:19.438016+0000","last_clean":"2023-07-29T16:38:19.438016+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:38:19.438016+0000","last_undegraded":"2023-07-29T16:38:19.438016+0000","last_fullsized":"2023-07-29T16:38:19.438016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430751+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:38:19.430751+0000","last_peered":"2023-07-29T16:38:19.430751+0000","last_clean":"2023-07-29T16:38:19.430751+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:38:19.430751+0000","last_undegraded":"2023-07-29T16:38:19.430751+0000","last_fullsized":"2023-07-29T16:38:19.430751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431155+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:38:19.431155+0000","last_peered":"2023-07-29T16:38:19.431155+0000","last_clean":"2023-07-29T16:38:19.431155+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:38:19.431155+0000","last_undegraded":"2023-07-29T16:38:19.431155+0000","last_fullsized":"2023-07-29T16:38:19.431155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437453+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:38:19.437453+0000","last_peered":"2023-07-29T16:38:19.437453+0000","last_clean":"2023-07-29T16:38:19.437453+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:38:19.437453+0000","last_undegraded":"2023-07-29T16:38:19.437453+0000","last_fullsized":"2023-07-29T16:38:19.437453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437333+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:38:19.437333+0000","last_peered":"2023-07-29T16:38:19.437333+0000","last_clean":"2023-07-29T16:38:19.437333+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:38:19.437333+0000","last_undegraded":"2023-07-29T16:38:19.437333+0000","last_fullsized":"2023-07-29T16:38:19.437333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437211+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:38:19.437211+0000","last_peered":"2023-07-29T16:38:19.437211+0000","last_clean":"2023-07-29T16:38:19.437211+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:38:19.437211+0000","last_undegraded":"2023-07-29T16:38:19.437211+0000","last_fullsized":"2023-07-29T16:38:19.437211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434652+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:38:19.434652+0000","last_peered":"2023-07-29T16:38:19.434652+0000","last_clean":"2023-07-29T16:38:19.434652+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:38:19.434652+0000","last_undegraded":"2023-07-29T16:38:19.434652+0000","last_fullsized":"2023-07-29T16:38:19.434652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431417+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:38:19.431417+0000","last_peered":"2023-07-29T16:38:19.431417+0000","last_clean":"2023-07-29T16:38:19.431417+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:38:19.431417+0000","last_undegraded":"2023-07-29T16:38:19.431417+0000","last_fullsized":"2023-07-29T16:38:19.431417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434286+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:38:19.434286+0000","last_peered":"2023-07-29T16:38:19.434286+0000","last_clean":"2023-07-29T16:38:19.434286+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:38:19.434286+0000","last_undegraded":"2023-07-29T16:38:19.434286+0000","last_fullsized":"2023-07-29T16:38:19.434286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437805+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:38:19.437805+0000","last_peered":"2023-07-29T16:38:19.437805+0000","last_clean":"2023-07-29T16:38:19.437805+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:38:19.437805+0000","last_undegraded":"2023-07-29T16:38:19.437805+0000","last_fullsized":"2023-07-29T16:38:19.437805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437508+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:38:19.437508+0000","last_peered":"2023-07-29T16:38:19.437508+0000","last_clean":"2023-07-29T16:38:19.437508+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:38:19.437508+0000","last_undegraded":"2023-07-29T16:38:19.437508+0000","last_fullsized":"2023-07-29T16:38:19.437508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430926+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:38:19.430926+0000","last_peered":"2023-07-29T16:38:19.430926+0000","last_clean":"2023-07-29T16:38:19.430926+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:38:19.430926+0000","last_undegraded":"2023-07-29T16:38:19.430926+0000","last_fullsized":"2023-07-29T16:38:19.430926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433965+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:38:19.433965+0000","last_peered":"2023-07-29T16:38:19.433965+0000","last_clean":"2023-07-29T16:38:19.433965+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:38:19.433965+0000","last_undegraded":"2023-07-29T16:38:19.433965+0000","last_fullsized":"2023-07-29T16:38:19.433965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430576+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:38:19.430576+0000","last_peered":"2023-07-29T16:38:19.430576+0000","last_clean":"2023-07-29T16:38:19.430576+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:38:19.430576+0000","last_undegraded":"2023-07-29T16:38:19.430576+0000","last_fullsized":"2023-07-29T16:38:19.430576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431522+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:38:19.431522+0000","last_peered":"2023-07-29T16:38:19.431522+0000","last_clean":"2023-07-29T16:38:19.431522+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:38:19.431522+0000","last_undegraded":"2023-07-29T16:38:19.431522+0000","last_fullsized":"2023-07-29T16:38:19.431522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434427+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:38:19.434427+0000","last_peered":"2023-07-29T16:38:19.434427+0000","last_clean":"2023-07-29T16:38:19.434427+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:38:19.434427+0000","last_undegraded":"2023-07-29T16:38:19.434427+0000","last_fullsized":"2023-07-29T16:38:19.434427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438242+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:38:19.438242+0000","last_peered":"2023-07-29T16:38:19.438242+0000","last_clean":"2023-07-29T16:38:19.438242+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:38:19.438242+0000","last_undegraded":"2023-07-29T16:38:19.438242+0000","last_fullsized":"2023-07-29T16:38:19.438242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430725+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:38:19.430725+0000","last_peered":"2023-07-29T16:38:19.430725+0000","last_clean":"2023-07-29T16:38:19.430725+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:38:19.430725+0000","last_undegraded":"2023-07-29T16:38:19.430725+0000","last_fullsized":"2023-07-29T16:38:19.430725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431066+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:38:19.431066+0000","last_peered":"2023-07-29T16:38:19.431066+0000","last_clean":"2023-07-29T16:38:19.431066+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:38:19.431066+0000","last_undegraded":"2023-07-29T16:38:19.431066+0000","last_fullsized":"2023-07-29T16:38:19.431066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434050+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:38:19.434050+0000","last_peered":"2023-07-29T16:38:19.434050+0000","last_clean":"2023-07-29T16:38:19.434050+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:38:19.434050+0000","last_undegraded":"2023-07-29T16:38:19.434050+0000","last_fullsized":"2023-07-29T16:38:19.434050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434562+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:38:19.434562+0000","last_peered":"2023-07-29T16:38:19.434562+0000","last_clean":"2023-07-29T16:38:19.434562+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:38:19.434562+0000","last_undegraded":"2023-07-29T16:38:19.434562+0000","last_fullsized":"2023-07-29T16:38:19.434562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433659+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:38:19.433659+0000","last_peered":"2023-07-29T16:38:19.433659+0000","last_clean":"2023-07-29T16:38:19.433659+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:38:19.433659+0000","last_undegraded":"2023-07-29T16:38:19.433659+0000","last_fullsized":"2023-07-29T16:38:19.433659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431504+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:38:19.431504+0000","last_peered":"2023-07-29T16:38:19.431504+0000","last_clean":"2023-07-29T16:38:19.431504+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:38:19.431504+0000","last_undegraded":"2023-07-29T16:38:19.431504+0000","last_fullsized":"2023-07-29T16:38:19.431504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435196+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:38:19.435196+0000","last_peered":"2023-07-29T16:38:19.435196+0000","last_clean":"2023-07-29T16:38:19.435196+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:38:19.435196+0000","last_undegraded":"2023-07-29T16:38:19.435196+0000","last_fullsized":"2023-07-29T16:38:19.435196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433687+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:38:19.433687+0000","last_peered":"2023-07-29T16:38:19.433687+0000","last_clean":"2023-07-29T16:38:19.433687+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:38:19.433687+0000","last_undegraded":"2023-07-29T16:38:19.433687+0000","last_fullsized":"2023-07-29T16:38:19.433687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437660+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:38:19.437660+0000","last_peered":"2023-07-29T16:38:19.437660+0000","last_clean":"2023-07-29T16:38:19.437660+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:38:19.437660+0000","last_undegraded":"2023-07-29T16:38:19.437660+0000","last_fullsized":"2023-07-29T16:38:19.437660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434198+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:38:19.434198+0000","last_peered":"2023-07-29T16:38:19.434198+0000","last_clean":"2023-07-29T16:38:19.434198+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:38:19.434198+0000","last_undegraded":"2023-07-29T16:38:19.434198+0000","last_fullsized":"2023-07-29T16:38:19.434198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431172+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:38:19.431172+0000","last_peered":"2023-07-29T16:38:19.431172+0000","last_clean":"2023-07-29T16:38:19.431172+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:38:19.431172+0000","last_undegraded":"2023-07-29T16:38:19.431172+0000","last_fullsized":"2023-07-29T16:38:19.431172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434203+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:38:19.434203+0000","last_peered":"2023-07-29T16:38:19.434203+0000","last_clean":"2023-07-29T16:38:19.434203+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:38:19.434203+0000","last_undegraded":"2023-07-29T16:38:19.434203+0000","last_fullsized":"2023-07-29T16:38:19.434203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437719+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:38:19.437719+0000","last_peered":"2023-07-29T16:38:19.437719+0000","last_clean":"2023-07-29T16:38:19.437719+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:38:19.437719+0000","last_undegraded":"2023-07-29T16:38:19.437719+0000","last_fullsized":"2023-07-29T16:38:19.437719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437346+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:38:19.437346+0000","last_peered":"2023-07-29T16:38:19.437346+0000","last_clean":"2023-07-29T16:38:19.437346+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:38:19.437346+0000","last_undegraded":"2023-07-29T16:38:19.437346+0000","last_fullsized":"2023-07-29T16:38:19.437346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437294+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:38:19.437294+0000","last_peered":"2023-07-29T16:38:19.437294+0000","last_clean":"2023-07-29T16:38:19.437294+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:38:19.437294+0000","last_undegraded":"2023-07-29T16:38:19.437294+0000","last_fullsized":"2023-07-29T16:38:19.437294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430845+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:38:19.430845+0000","last_peered":"2023-07-29T16:38:19.430845+0000","last_clean":"2023-07-29T16:38:19.430845+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:38:19.430845+0000","last_undegraded":"2023-07-29T16:38:19.430845+0000","last_fullsized":"2023-07-29T16:38:19.430845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434551+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:38:19.434551+0000","last_peered":"2023-07-29T16:38:19.434551+0000","last_clean":"2023-07-29T16:38:19.434551+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:38:19.434551+0000","last_undegraded":"2023-07-29T16:38:19.434551+0000","last_fullsized":"2023-07-29T16:38:19.434551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431152+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:38:19.431152+0000","last_peered":"2023-07-29T16:38:19.431152+0000","last_clean":"2023-07-29T16:38:19.431152+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:38:19.431152+0000","last_undegraded":"2023-07-29T16:38:19.431152+0000","last_fullsized":"2023-07-29T16:38:19.431152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430813+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:38:19.430813+0000","last_peered":"2023-07-29T16:38:19.430813+0000","last_clean":"2023-07-29T16:38:19.430813+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:38:19.430813+0000","last_undegraded":"2023-07-29T16:38:19.430813+0000","last_fullsized":"2023-07-29T16:38:19.430813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434721+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:38:19.434721+0000","last_peered":"2023-07-29T16:38:19.434721+0000","last_clean":"2023-07-29T16:38:19.434721+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:38:19.434721+0000","last_undegraded":"2023-07-29T16:38:19.434721+0000","last_fullsized":"2023-07-29T16:38:19.434721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437071+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:38:19.437071+0000","last_peered":"2023-07-29T16:38:19.437071+0000","last_clean":"2023-07-29T16:38:19.437071+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:38:19.437071+0000","last_undegraded":"2023-07-29T16:38:19.437071+0000","last_fullsized":"2023-07-29T16:38:19.437071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435334+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:38:19.435334+0000","last_peered":"2023-07-29T16:38:19.435334+0000","last_clean":"2023-07-29T16:38:19.435334+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:38:19.435334+0000","last_undegraded":"2023-07-29T16:38:19.435334+0000","last_fullsized":"2023-07-29T16:38:19.435334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'1028","reported_seq":1040,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.486988+0000","last_change":"2023-07-29T16:38:15.000885+0000","last_active":"2023-07-29T16:38:20.486988+0000","last_peered":"2023-07-29T16:38:20.486988+0000","last_clean":"2023-07-29T16:38:20.486988+0000","last_became_active":"2023-07-29T16:38:15.000700+0000","last_became_peered":"2023-07-29T16:38:15.000700+0000","last_unstale":"2023-07-29T16:38:20.486988+0000","last_undegraded":"2023-07-29T16:38:20.486988+0000","last_fullsized":"2023-07-29T16:38:20.486988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:28.796109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438115+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:38:19.438115+0000","last_peered":"2023-07-29T16:38:19.438115+0000","last_clean":"2023-07-29T16:38:19.438115+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:38:19.438115+0000","last_undegraded":"2023-07-29T16:38:19.438115+0000","last_fullsized":"2023-07-29T16:38:19.438115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430943+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:38:19.430943+0000","last_peered":"2023-07-29T16:38:19.430943+0000","last_clean":"2023-07-29T16:38:19.430943+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:38:19.430943+0000","last_undegraded":"2023-07-29T16:38:19.430943+0000","last_fullsized":"2023-07-29T16:38:19.430943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"24'1039","reported_seq":1052,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.491565+0000","last_change":"2023-07-29T16:38:15.002940+0000","last_active":"2023-07-29T16:38:20.491565+0000","last_peered":"2023-07-29T16:38:20.491565+0000","last_clean":"2023-07-29T16:38:20.491565+0000","last_became_active":"2023-07-29T16:38:15.002741+0000","last_became_peered":"2023-07-29T16:38:15.002741+0000","last_unstale":"2023-07-29T16:38:20.491565+0000","last_undegraded":"2023-07-29T16:38:20.491565+0000","last_fullsized":"2023-07-29T16:38:20.491565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68091904,"num_objects":1039,"num_object_clones":0,"num_object_copies":2078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":66496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431267+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:38:19.431267+0000","last_peered":"2023-07-29T16:38:19.431267+0000","last_clean":"2023-07-29T16:38:19.431267+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:38:19.431267+0000","last_undegraded":"2023-07-29T16:38:19.431267+0000","last_fullsized":"2023-07-29T16:38:19.431267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431023+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:38:19.431023+0000","last_peered":"2023-07-29T16:38:19.431023+0000","last_clean":"2023-07-29T16:38:19.431023+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:38:19.431023+0000","last_undegraded":"2023-07-29T16:38:19.431023+0000","last_fullsized":"2023-07-29T16:38:19.431023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"24'995","reported_seq":1008,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.505028+0000","last_change":"2023-07-29T16:38:15.002847+0000","last_active":"2023-07-29T16:38:20.505028+0000","last_peered":"2023-07-29T16:38:20.505028+0000","last_clean":"2023-07-29T16:38:20.505028+0000","last_became_active":"2023-07-29T16:38:15.002520+0000","last_became_peered":"2023-07-29T16:38:15.002520+0000","last_unstale":"2023-07-29T16:38:20.505028+0000","last_undegraded":"2023-07-29T16:38:20.505028+0000","last_fullsized":"2023-07-29T16:38:20.505028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438017+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:38:19.438017+0000","last_peered":"2023-07-29T16:38:19.438017+0000","last_clean":"2023-07-29T16:38:19.438017+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:38:19.438017+0000","last_undegraded":"2023-07-29T16:38:19.438017+0000","last_fullsized":"2023-07-29T16:38:19.438017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437355+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:38:19.437355+0000","last_peered":"2023-07-29T16:38:19.437355+0000","last_clean":"2023-07-29T16:38:19.437355+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:38:19.437355+0000","last_undegraded":"2023-07-29T16:38:19.437355+0000","last_fullsized":"2023-07-29T16:38:19.437355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"24'985","reported_seq":998,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.509862+0000","last_change":"2023-07-29T16:38:15.003542+0000","last_active":"2023-07-29T16:38:20.509862+0000","last_peered":"2023-07-29T16:38:20.509862+0000","last_clean":"2023-07-29T16:38:20.509862+0000","last_became_active":"2023-07-29T16:38:15.003374+0000","last_became_peered":"2023-07-29T16:38:15.003374+0000","last_unstale":"2023-07-29T16:38:20.509862+0000","last_undegraded":"2023-07-29T16:38:20.509862+0000","last_fullsized":"2023-07-29T16:38:20.509862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":985,"log_dups_size":0,"ondisk_log_size":985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:17:50.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":985,"num_write_kb":63040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437534+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:38:19.437534+0000","last_peered":"2023-07-29T16:38:19.437534+0000","last_clean":"2023-07-29T16:38:19.437534+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:38:19.437534+0000","last_undegraded":"2023-07-29T16:38:19.437534+0000","last_fullsized":"2023-07-29T16:38:19.437534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434212+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:38:19.434212+0000","last_peered":"2023-07-29T16:38:19.434212+0000","last_clean":"2023-07-29T16:38:19.434212+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:38:19.434212+0000","last_undegraded":"2023-07-29T16:38:19.434212+0000","last_fullsized":"2023-07-29T16:38:19.434212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'1015","reported_seq":1028,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504879+0000","last_change":"2023-07-29T16:38:15.000783+0000","last_active":"2023-07-29T16:38:20.504879+0000","last_peered":"2023-07-29T16:38:20.504879+0000","last_clean":"2023-07-29T16:38:20.504879+0000","last_became_active":"2023-07-29T16:38:15.000526+0000","last_became_peered":"2023-07-29T16:38:15.000526+0000","last_unstale":"2023-07-29T16:38:20.504879+0000","last_undegraded":"2023-07-29T16:38:20.504879+0000","last_fullsized":"2023-07-29T16:38:20.504879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:37.626808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66519040,"num_objects":1015,"num_object_clones":0,"num_object_copies":2030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":64960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434119+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:38:19.434119+0000","last_peered":"2023-07-29T16:38:19.434119+0000","last_clean":"2023-07-29T16:38:19.434119+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:38:19.434119+0000","last_undegraded":"2023-07-29T16:38:19.434119+0000","last_fullsized":"2023-07-29T16:38:19.434119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437475+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:38:19.437475+0000","last_peered":"2023-07-29T16:38:19.437475+0000","last_clean":"2023-07-29T16:38:19.437475+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:38:19.437475+0000","last_undegraded":"2023-07-29T16:38:19.437475+0000","last_fullsized":"2023-07-29T16:38:19.437475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"24'1066","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497791+0000","last_change":"2023-07-29T16:38:15.002770+0000","last_active":"2023-07-29T16:38:20.497791+0000","last_peered":"2023-07-29T16:38:20.497791+0000","last_clean":"2023-07-29T16:38:20.497791+0000","last_became_active":"2023-07-29T16:38:15.002365+0000","last_became_peered":"2023-07-29T16:38:15.002365+0000","last_unstale":"2023-07-29T16:38:20.497791+0000","last_undegraded":"2023-07-29T16:38:20.497791+0000","last_fullsized":"2023-07-29T16:38:20.497791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:31:33.326032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69861376,"num_objects":1066,"num_object_clones":0,"num_object_copies":2132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437229+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:38:19.437229+0000","last_peered":"2023-07-29T16:38:19.437229+0000","last_clean":"2023-07-29T16:38:19.437229+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:38:19.437229+0000","last_undegraded":"2023-07-29T16:38:19.437229+0000","last_fullsized":"2023-07-29T16:38:19.437229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438206+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:38:19.438206+0000","last_peered":"2023-07-29T16:38:19.438206+0000","last_clean":"2023-07-29T16:38:19.438206+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:38:19.438206+0000","last_undegraded":"2023-07-29T16:38:19.438206+0000","last_fullsized":"2023-07-29T16:38:19.438206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"24'1035","reported_seq":1048,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504907+0000","last_change":"2023-07-29T16:38:15.000922+0000","last_active":"2023-07-29T16:38:20.504907+0000","last_peered":"2023-07-29T16:38:20.504907+0000","last_clean":"2023-07-29T16:38:20.504907+0000","last_became_active":"2023-07-29T16:38:15.000713+0000","last_became_peered":"2023-07-29T16:38:15.000713+0000","last_unstale":"2023-07-29T16:38:20.504907+0000","last_undegraded":"2023-07-29T16:38:20.504907+0000","last_fullsized":"2023-07-29T16:38:20.504907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:47:48.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67829760,"num_objects":1035,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":66240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430597+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:38:19.430597+0000","last_peered":"2023-07-29T16:38:19.430597+0000","last_clean":"2023-07-29T16:38:19.430597+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:38:19.430597+0000","last_undegraded":"2023-07-29T16:38:19.430597+0000","last_fullsized":"2023-07-29T16:38:19.430597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437712+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:38:19.437712+0000","last_peered":"2023-07-29T16:38:19.437712+0000","last_clean":"2023-07-29T16:38:19.437712+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:38:19.437712+0000","last_undegraded":"2023-07-29T16:38:19.437712+0000","last_fullsized":"2023-07-29T16:38:19.437712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"24'993","reported_seq":1004,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507883+0000","last_change":"2023-07-29T16:38:15.002931+0000","last_active":"2023-07-29T16:38:20.507883+0000","last_peered":"2023-07-29T16:38:20.507883+0000","last_clean":"2023-07-29T16:38:20.507883+0000","last_became_active":"2023-07-29T16:38:15.002633+0000","last_became_peered":"2023-07-29T16:38:15.002633+0000","last_unstale":"2023-07-29T16:38:20.507883+0000","last_undegraded":"2023-07-29T16:38:20.507883+0000","last_fullsized":"2023-07-29T16:38:20.507883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:28.941722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430774+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:38:19.430774+0000","last_peered":"2023-07-29T16:38:19.430774+0000","last_clean":"2023-07-29T16:38:19.430774+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:38:19.430774+0000","last_undegraded":"2023-07-29T16:38:19.430774+0000","last_fullsized":"2023-07-29T16:38:19.430774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434825+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:38:19.434825+0000","last_peered":"2023-07-29T16:38:19.434825+0000","last_clean":"2023-07-29T16:38:19.434825+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:38:19.434825+0000","last_undegraded":"2023-07-29T16:38:19.434825+0000","last_fullsized":"2023-07-29T16:38:19.434825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"24'1068","reported_seq":1081,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497760+0000","last_change":"2023-07-29T16:38:15.002651+0000","last_active":"2023-07-29T16:38:20.497760+0000","last_peered":"2023-07-29T16:38:20.497760+0000","last_clean":"2023-07-29T16:38:20.497760+0000","last_became_active":"2023-07-29T16:38:15.002346+0000","last_became_peered":"2023-07-29T16:38:15.002346+0000","last_unstale":"2023-07-29T16:38:20.497760+0000","last_undegraded":"2023-07-29T16:38:20.497760+0000","last_fullsized":"2023-07-29T16:38:20.497760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:26:01.849953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69992448,"num_objects":1068,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434833+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:38:19.434833+0000","last_peered":"2023-07-29T16:38:19.434833+0000","last_clean":"2023-07-29T16:38:19.434833+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:38:19.434833+0000","last_undegraded":"2023-07-29T16:38:19.434833+0000","last_fullsized":"2023-07-29T16:38:19.434833+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438122+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:38:19.438122+0000","last_peered":"2023-07-29T16:38:19.438122+0000","last_clean":"2023-07-29T16:38:19.438122+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:38:19.438122+0000","last_undegraded":"2023-07-29T16:38:19.438122+0000","last_fullsized":"2023-07-29T16:38:19.438122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430818+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:38:19.430818+0000","last_peered":"2023-07-29T16:38:19.430818+0000","last_clean":"2023-07-29T16:38:19.430818+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:38:19.430818+0000","last_undegraded":"2023-07-29T16:38:19.430818+0000","last_fullsized":"2023-07-29T16:38:19.430818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"24'1048","reported_seq":1061,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497996+0000","last_change":"2023-07-29T16:38:15.002643+0000","last_active":"2023-07-29T16:38:20.497996+0000","last_peered":"2023-07-29T16:38:20.497996+0000","last_clean":"2023-07-29T16:38:20.497996+0000","last_became_active":"2023-07-29T16:38:15.002395+0000","last_became_peered":"2023-07-29T16:38:15.002395+0000","last_unstale":"2023-07-29T16:38:20.497996+0000","last_undegraded":"2023-07-29T16:38:20.497996+0000","last_fullsized":"2023-07-29T16:38:20.497996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:07:10.753410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68681728,"num_objects":1048,"num_object_clones":0,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437362+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:38:19.437362+0000","last_peered":"2023-07-29T16:38:19.437362+0000","last_clean":"2023-07-29T16:38:19.437362+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:38:19.437362+0000","last_undegraded":"2023-07-29T16:38:19.437362+0000","last_fullsized":"2023-07-29T16:38:19.437362+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437203+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:38:19.437203+0000","last_peered":"2023-07-29T16:38:19.437203+0000","last_clean":"2023-07-29T16:38:19.437203+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:38:19.437203+0000","last_undegraded":"2023-07-29T16:38:19.437203+0000","last_fullsized":"2023-07-29T16:38:19.437203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434462+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:38:19.434462+0000","last_peered":"2023-07-29T16:38:19.434462+0000","last_clean":"2023-07-29T16:38:19.434462+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:38:19.434462+0000","last_undegraded":"2023-07-29T16:38:19.434462+0000","last_fullsized":"2023-07-29T16:38:19.434462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"24'960","reported_seq":973,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.484587+0000","last_change":"2023-07-29T16:38:15.002654+0000","last_active":"2023-07-29T16:38:20.484587+0000","last_peered":"2023-07-29T16:38:20.484587+0000","last_clean":"2023-07-29T16:38:20.484587+0000","last_became_active":"2023-07-29T16:38:15.002431+0000","last_became_peered":"2023-07-29T16:38:15.002431+0000","last_unstale":"2023-07-29T16:38:20.484587+0000","last_undegraded":"2023-07-29T16:38:20.484587+0000","last_fullsized":"2023-07-29T16:38:20.484587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:18.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433883+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:38:19.433883+0000","last_peered":"2023-07-29T16:38:19.433883+0000","last_clean":"2023-07-29T16:38:19.433883+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:38:19.433883+0000","last_undegraded":"2023-07-29T16:38:19.433883+0000","last_fullsized":"2023-07-29T16:38:19.433883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430676+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:38:19.430676+0000","last_peered":"2023-07-29T16:38:19.430676+0000","last_clean":"2023-07-29T16:38:19.430676+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:38:19.430676+0000","last_undegraded":"2023-07-29T16:38:19.430676+0000","last_fullsized":"2023-07-29T16:38:19.430676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435254+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:38:19.435254+0000","last_peered":"2023-07-29T16:38:19.435254+0000","last_clean":"2023-07-29T16:38:19.435254+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:38:19.435254+0000","last_undegraded":"2023-07-29T16:38:19.435254+0000","last_fullsized":"2023-07-29T16:38:19.435254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"24'1043","reported_seq":1056,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504958+0000","last_change":"2023-07-29T16:38:15.002929+0000","last_active":"2023-07-29T16:38:20.504958+0000","last_peered":"2023-07-29T16:38:20.504958+0000","last_clean":"2023-07-29T16:38:20.504958+0000","last_became_active":"2023-07-29T16:38:15.002588+0000","last_became_peered":"2023-07-29T16:38:15.002588+0000","last_unstale":"2023-07-29T16:38:20.504958+0000","last_undegraded":"2023-07-29T16:38:20.504958+0000","last_fullsized":"2023-07-29T16:38:20.504958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:55.768262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68354048,"num_objects":1043,"num_object_clones":0,"num_object_copies":2086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":66752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437194+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:38:19.437194+0000","last_peered":"2023-07-29T16:38:19.437194+0000","last_clean":"2023-07-29T16:38:19.437194+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:38:19.437194+0000","last_undegraded":"2023-07-29T16:38:19.437194+0000","last_fullsized":"2023-07-29T16:38:19.437194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437172+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:38:19.437172+0000","last_peered":"2023-07-29T16:38:19.437172+0000","last_clean":"2023-07-29T16:38:19.437172+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:38:19.437172+0000","last_undegraded":"2023-07-29T16:38:19.437172+0000","last_fullsized":"2023-07-29T16:38:19.437172+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434120+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:38:19.434120+0000","last_peered":"2023-07-29T16:38:19.434120+0000","last_clean":"2023-07-29T16:38:19.434120+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:38:19.434120+0000","last_undegraded":"2023-07-29T16:38:19.434120+0000","last_fullsized":"2023-07-29T16:38:19.434120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438170+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:38:19.438170+0000","last_peered":"2023-07-29T16:38:19.438170+0000","last_clean":"2023-07-29T16:38:19.438170+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:38:19.438170+0000","last_undegraded":"2023-07-29T16:38:19.438170+0000","last_fullsized":"2023-07-29T16:38:19.438170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"24'992","reported_seq":1005,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.512439+0000","last_change":"2023-07-29T16:38:15.002704+0000","last_active":"2023-07-29T16:38:20.512439+0000","last_peered":"2023-07-29T16:38:20.512439+0000","last_clean":"2023-07-29T16:38:20.512439+0000","last_became_active":"2023-07-29T16:38:15.002458+0000","last_became_peered":"2023-07-29T16:38:15.002458+0000","last_unstale":"2023-07-29T16:38:20.512439+0000","last_undegraded":"2023-07-29T16:38:20.512439+0000","last_fullsized":"2023-07-29T16:38:20.512439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436944+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:38:19.436944+0000","last_peered":"2023-07-29T16:38:19.436944+0000","last_clean":"2023-07-29T16:38:19.436944+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:38:19.436944+0000","last_undegraded":"2023-07-29T16:38:19.436944+0000","last_fullsized":"2023-07-29T16:38:19.436944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434417+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:38:19.434417+0000","last_peered":"2023-07-29T16:38:19.434417+0000","last_clean":"2023-07-29T16:38:19.434417+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:38:19.434417+0000","last_undegraded":"2023-07-29T16:38:19.434417+0000","last_fullsized":"2023-07-29T16:38:19.434417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431340+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:38:19.431340+0000","last_peered":"2023-07-29T16:38:19.431340+0000","last_clean":"2023-07-29T16:38:19.431340+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:38:19.431340+0000","last_undegraded":"2023-07-29T16:38:19.431340+0000","last_fullsized":"2023-07-29T16:38:19.431340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"24'1028","reported_seq":1041,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503520+0000","last_change":"2023-07-29T16:38:15.002764+0000","last_active":"2023-07-29T16:38:20.503520+0000","last_peered":"2023-07-29T16:38:20.503520+0000","last_clean":"2023-07-29T16:38:20.503520+0000","last_became_active":"2023-07-29T16:38:15.002492+0000","last_became_peered":"2023-07-29T16:38:15.002492+0000","last_unstale":"2023-07-29T16:38:20.503520+0000","last_undegraded":"2023-07-29T16:38:20.503520+0000","last_fullsized":"2023-07-29T16:38:20.503520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431253+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:38:19.431253+0000","last_peered":"2023-07-29T16:38:19.431253+0000","last_clean":"2023-07-29T16:38:19.431253+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:38:19.431253+0000","last_undegraded":"2023-07-29T16:38:19.431253+0000","last_fullsized":"2023-07-29T16:38:19.431253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434411+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:38:19.434411+0000","last_peered":"2023-07-29T16:38:19.434411+0000","last_clean":"2023-07-29T16:38:19.434411+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:38:19.434411+0000","last_undegraded":"2023-07-29T16:38:19.434411+0000","last_fullsized":"2023-07-29T16:38:19.434411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431099+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:38:19.431099+0000","last_peered":"2023-07-29T16:38:19.431099+0000","last_clean":"2023-07-29T16:38:19.431099+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:38:19.431099+0000","last_undegraded":"2023-07-29T16:38:19.431099+0000","last_fullsized":"2023-07-29T16:38:19.431099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"24'1034","reported_seq":1047,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503077+0000","last_change":"2023-07-29T16:38:15.002836+0000","last_active":"2023-07-29T16:38:20.503077+0000","last_peered":"2023-07-29T16:38:20.503077+0000","last_clean":"2023-07-29T16:38:20.503077+0000","last_became_active":"2023-07-29T16:38:15.002549+0000","last_became_peered":"2023-07-29T16:38:15.002549+0000","last_unstale":"2023-07-29T16:38:20.503077+0000","last_undegraded":"2023-07-29T16:38:20.503077+0000","last_fullsized":"2023-07-29T16:38:20.503077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":2068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434740+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:38:19.434740+0000","last_peered":"2023-07-29T16:38:19.434740+0000","last_clean":"2023-07-29T16:38:19.434740+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:38:19.434740+0000","last_undegraded":"2023-07-29T16:38:19.434740+0000","last_fullsized":"2023-07-29T16:38:19.434740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434755+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:38:19.434755+0000","last_peered":"2023-07-29T16:38:19.434755+0000","last_clean":"2023-07-29T16:38:19.434755+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:38:19.434755+0000","last_undegraded":"2023-07-29T16:38:19.434755+0000","last_fullsized":"2023-07-29T16:38:19.434755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433598+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:38:19.433598+0000","last_peered":"2023-07-29T16:38:19.433598+0000","last_clean":"2023-07-29T16:38:19.433598+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:38:19.433598+0000","last_undegraded":"2023-07-29T16:38:19.433598+0000","last_fullsized":"2023-07-29T16:38:19.433598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"24'1075","reported_seq":1088,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507497+0000","last_change":"2023-07-29T16:38:15.003063+0000","last_active":"2023-07-29T16:38:20.507497+0000","last_peered":"2023-07-29T16:38:20.507497+0000","last_clean":"2023-07-29T16:38:20.507497+0000","last_became_active":"2023-07-29T16:38:15.002814+0000","last_became_peered":"2023-07-29T16:38:15.002814+0000","last_unstale":"2023-07-29T16:38:20.507497+0000","last_undegraded":"2023-07-29T16:38:20.507497+0000","last_fullsized":"2023-07-29T16:38:20.507497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70451200,"num_objects":1075,"num_object_clones":0,"num_object_copies":2150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":68800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438193+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:38:19.438193+0000","last_peered":"2023-07-29T16:38:19.438193+0000","last_clean":"2023-07-29T16:38:19.438193+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:38:19.438193+0000","last_undegraded":"2023-07-29T16:38:19.438193+0000","last_fullsized":"2023-07-29T16:38:19.438193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434513+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:38:19.434513+0000","last_peered":"2023-07-29T16:38:19.434513+0000","last_clean":"2023-07-29T16:38:19.434513+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:38:19.434513+0000","last_undegraded":"2023-07-29T16:38:19.434513+0000","last_fullsized":"2023-07-29T16:38:19.434513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430962+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:38:19.430962+0000","last_peered":"2023-07-29T16:38:19.430962+0000","last_clean":"2023-07-29T16:38:19.430962+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:38:19.430962+0000","last_undegraded":"2023-07-29T16:38:19.430962+0000","last_fullsized":"2023-07-29T16:38:19.430962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430891+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:38:19.430891+0000","last_peered":"2023-07-29T16:38:19.430891+0000","last_clean":"2023-07-29T16:38:19.430891+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:38:19.430891+0000","last_undegraded":"2023-07-29T16:38:19.430891+0000","last_fullsized":"2023-07-29T16:38:19.430891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431017+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:38:19.431017+0000","last_peered":"2023-07-29T16:38:19.431017+0000","last_clean":"2023-07-29T16:38:19.431017+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:38:19.431017+0000","last_undegraded":"2023-07-29T16:38:19.431017+0000","last_fullsized":"2023-07-29T16:38:19.431017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437629+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:38:19.437629+0000","last_peered":"2023-07-29T16:38:19.437629+0000","last_clean":"2023-07-29T16:38:19.437629+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:38:19.437629+0000","last_undegraded":"2023-07-29T16:38:19.437629+0000","last_fullsized":"2023-07-29T16:38:19.437629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437384+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:38:19.437384+0000","last_peered":"2023-07-29T16:38:19.437384+0000","last_clean":"2023-07-29T16:38:19.437384+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:38:19.437384+0000","last_undegraded":"2023-07-29T16:38:19.437384+0000","last_fullsized":"2023-07-29T16:38:19.437384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431332+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:38:19.431332+0000","last_peered":"2023-07-29T16:38:19.431332+0000","last_clean":"2023-07-29T16:38:19.431332+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:38:19.431332+0000","last_undegraded":"2023-07-29T16:38:19.431332+0000","last_fullsized":"2023-07-29T16:38:19.431332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437265+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:38:19.437265+0000","last_peered":"2023-07-29T16:38:19.437265+0000","last_clean":"2023-07-29T16:38:19.437265+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:38:19.437265+0000","last_undegraded":"2023-07-29T16:38:19.437265+0000","last_fullsized":"2023-07-29T16:38:19.437265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434672+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:38:19.434672+0000","last_peered":"2023-07-29T16:38:19.434672+0000","last_clean":"2023-07-29T16:38:19.434672+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:38:19.434672+0000","last_undegraded":"2023-07-29T16:38:19.434672+0000","last_fullsized":"2023-07-29T16:38:19.434672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430587+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:38:19.430587+0000","last_peered":"2023-07-29T16:38:19.430587+0000","last_clean":"2023-07-29T16:38:19.430587+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:38:19.430587+0000","last_undegraded":"2023-07-29T16:38:19.430587+0000","last_fullsized":"2023-07-29T16:38:19.430587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434909+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:38:19.434909+0000","last_peered":"2023-07-29T16:38:19.434909+0000","last_clean":"2023-07-29T16:38:19.434909+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:38:19.434909+0000","last_undegraded":"2023-07-29T16:38:19.434909+0000","last_fullsized":"2023-07-29T16:38:19.434909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437122+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:38:19.437122+0000","last_peered":"2023-07-29T16:38:19.437122+0000","last_clean":"2023-07-29T16:38:19.437122+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:38:19.437122+0000","last_undegraded":"2023-07-29T16:38:19.437122+0000","last_fullsized":"2023-07-29T16:38:19.437122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437029+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:38:19.437029+0000","last_peered":"2023-07-29T16:38:19.437029+0000","last_clean":"2023-07-29T16:38:19.437029+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:38:19.437029+0000","last_undegraded":"2023-07-29T16:38:19.437029+0000","last_fullsized":"2023-07-29T16:38:19.437029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433795+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:38:19.433795+0000","last_peered":"2023-07-29T16:38:19.433795+0000","last_clean":"2023-07-29T16:38:19.433795+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:38:19.433795+0000","last_undegraded":"2023-07-29T16:38:19.433795+0000","last_fullsized":"2023-07-29T16:38:19.433795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430905+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:38:19.430905+0000","last_peered":"2023-07-29T16:38:19.430905+0000","last_clean":"2023-07-29T16:38:19.430905+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:38:19.430905+0000","last_undegraded":"2023-07-29T16:38:19.430905+0000","last_fullsized":"2023-07-29T16:38:19.430905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434430+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:38:19.434430+0000","last_peered":"2023-07-29T16:38:19.434430+0000","last_clean":"2023-07-29T16:38:19.434430+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:38:19.434430+0000","last_undegraded":"2023-07-29T16:38:19.434430+0000","last_fullsized":"2023-07-29T16:38:19.434430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431071+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:38:19.431071+0000","last_peered":"2023-07-29T16:38:19.431071+0000","last_clean":"2023-07-29T16:38:19.431071+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:38:19.431071+0000","last_undegraded":"2023-07-29T16:38:19.431071+0000","last_fullsized":"2023-07-29T16:38:19.431071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134467584,"data_stored":2151481344,"data_compressed":10286086,"data_compressed_allocated":134467584,"data_compressed_original":2151481344,"omap_allocated":0,"internal_metadata":0},"log_size":16404,"ondisk_log_size":16404,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71532,"kb_used_data":44580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94300308,"statfs":{"total":96636764160,"available":96563515392,"internally_reserved":0,"allocated":45649920,"data_stored":726873905,"data_compressed":3473226,"data_compressed_allocated":45424640,"data_compressed_original":726794240,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67452,"kb_used_data":36404,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94304388,"statfs":{"total":96636764160,"available":96567693312,"internally_reserved":0,"allocated":37277696,"data_stored":592330171,"data_compressed":2838654,"data_compressed_allocated":37015552,"data_compressed_original":592232448,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66056,"kb_used_data":35008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94305784,"statfs":{"total":96636764160,"available":96569122816,"internally_reserved":0,"allocated":35848192,"data_stored":569327651,"data_compressed":2727652,"data_compressed_allocated":35577856,"data_compressed_original":569229312,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37736448,"data_stored":603783168,"data_compressed":2886683,"data_compressed_allocated":37736448,"data_compressed_original":603783168,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42123264,"data_stored":673972224,"data_compressed":3222189,"data_compressed_allocated":42123264,"data_compressed_original":673972224,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":54607872,"data_stored":873725952,"data_compressed":4177214,"data_compressed_allocated":54607872,"data_compressed_original":873725952,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:22.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:22.198 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:22.199 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:22.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:22.223 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:22.221+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:22.324 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:22.322+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:22.394 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:22.395 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:22.410 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:22.425 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:22.423+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:22.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:38:22.525 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:22.522+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:22.549 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-29T16:38:21.465664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1075645274,"num_objects":16428,"num_object_clones":0,"num_object_copies":32856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16428,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":16652,"num_write_kb":1053330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16600,"ondisk_log_size":16600,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":205040,"kb_used_data":115992,"kb_used_omap":0,"kb_used_meta":89024,"kb_avail":282910480,"statfs":{"total":289910292480,"available":289700331520,"internally_reserved":0,"allocated":118775808,"data_stored":1888531727,"data_compressed":9039532,"data_compressed_allocated":118018048,"data_compressed_original":1888256000,"omap_allocated":0,"internal_metadata":91160576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.467129"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431398+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:38:19.431398+0000","last_peered":"2023-07-29T16:38:19.431398+0000","last_clean":"2023-07-29T16:38:19.431398+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:38:19.431398+0000","last_undegraded":"2023-07-29T16:38:19.431398+0000","last_fullsized":"2023-07-29T16:38:19.431398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431256+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:38:19.431256+0000","last_peered":"2023-07-29T16:38:19.431256+0000","last_clean":"2023-07-29T16:38:19.431256+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:38:19.431256+0000","last_undegraded":"2023-07-29T16:38:19.431256+0000","last_fullsized":"2023-07-29T16:38:19.431256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438098+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:38:19.438098+0000","last_peered":"2023-07-29T16:38:19.438098+0000","last_clean":"2023-07-29T16:38:19.438098+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:38:19.438098+0000","last_undegraded":"2023-07-29T16:38:19.438098+0000","last_fullsized":"2023-07-29T16:38:19.438098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437879+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:38:19.437879+0000","last_peered":"2023-07-29T16:38:19.437879+0000","last_clean":"2023-07-29T16:38:19.437879+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:38:19.437879+0000","last_undegraded":"2023-07-29T16:38:19.437879+0000","last_fullsized":"2023-07-29T16:38:19.437879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430777+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:38:19.430777+0000","last_peered":"2023-07-29T16:38:19.430777+0000","last_clean":"2023-07-29T16:38:19.430777+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:38:19.430777+0000","last_undegraded":"2023-07-29T16:38:19.430777+0000","last_fullsized":"2023-07-29T16:38:19.430777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437461+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:38:19.437461+0000","last_peered":"2023-07-29T16:38:19.437461+0000","last_clean":"2023-07-29T16:38:19.437461+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:38:19.437461+0000","last_undegraded":"2023-07-29T16:38:19.437461+0000","last_fullsized":"2023-07-29T16:38:19.437461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437532+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:38:19.437532+0000","last_peered":"2023-07-29T16:38:19.437532+0000","last_clean":"2023-07-29T16:38:19.437532+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:38:19.437532+0000","last_undegraded":"2023-07-29T16:38:19.437532+0000","last_fullsized":"2023-07-29T16:38:19.437532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436968+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:38:19.436968+0000","last_peered":"2023-07-29T16:38:19.436968+0000","last_clean":"2023-07-29T16:38:19.436968+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:38:19.436968+0000","last_undegraded":"2023-07-29T16:38:19.436968+0000","last_fullsized":"2023-07-29T16:38:19.436968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434569+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:38:19.434569+0000","last_peered":"2023-07-29T16:38:19.434569+0000","last_clean":"2023-07-29T16:38:19.434569+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:38:19.434569+0000","last_undegraded":"2023-07-29T16:38:19.434569+0000","last_fullsized":"2023-07-29T16:38:19.434569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431427+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:38:19.431427+0000","last_peered":"2023-07-29T16:38:19.431427+0000","last_clean":"2023-07-29T16:38:19.431427+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:38:19.431427+0000","last_undegraded":"2023-07-29T16:38:19.431427+0000","last_fullsized":"2023-07-29T16:38:19.431427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438016+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:38:19.438016+0000","last_peered":"2023-07-29T16:38:19.438016+0000","last_clean":"2023-07-29T16:38:19.438016+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:38:19.438016+0000","last_undegraded":"2023-07-29T16:38:19.438016+0000","last_fullsized":"2023-07-29T16:38:19.438016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430751+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:38:19.430751+0000","last_peered":"2023-07-29T16:38:19.430751+0000","last_clean":"2023-07-29T16:38:19.430751+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:38:19.430751+0000","last_undegraded":"2023-07-29T16:38:19.430751+0000","last_fullsized":"2023-07-29T16:38:19.430751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431155+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:38:19.431155+0000","last_peered":"2023-07-29T16:38:19.431155+0000","last_clean":"2023-07-29T16:38:19.431155+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:38:19.431155+0000","last_undegraded":"2023-07-29T16:38:19.431155+0000","last_fullsized":"2023-07-29T16:38:19.431155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437453+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:38:19.437453+0000","last_peered":"2023-07-29T16:38:19.437453+0000","last_clean":"2023-07-29T16:38:19.437453+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:38:19.437453+0000","last_undegraded":"2023-07-29T16:38:19.437453+0000","last_fullsized":"2023-07-29T16:38:19.437453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437333+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:38:19.437333+0000","last_peered":"2023-07-29T16:38:19.437333+0000","last_clean":"2023-07-29T16:38:19.437333+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:38:19.437333+0000","last_undegraded":"2023-07-29T16:38:19.437333+0000","last_fullsized":"2023-07-29T16:38:19.437333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437211+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:38:19.437211+0000","last_peered":"2023-07-29T16:38:19.437211+0000","last_clean":"2023-07-29T16:38:19.437211+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:38:19.437211+0000","last_undegraded":"2023-07-29T16:38:19.437211+0000","last_fullsized":"2023-07-29T16:38:19.437211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434652+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:38:19.434652+0000","last_peered":"2023-07-29T16:38:19.434652+0000","last_clean":"2023-07-29T16:38:19.434652+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:38:19.434652+0000","last_undegraded":"2023-07-29T16:38:19.434652+0000","last_fullsized":"2023-07-29T16:38:19.434652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431417+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:38:19.431417+0000","last_peered":"2023-07-29T16:38:19.431417+0000","last_clean":"2023-07-29T16:38:19.431417+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:38:19.431417+0000","last_undegraded":"2023-07-29T16:38:19.431417+0000","last_fullsized":"2023-07-29T16:38:19.431417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434286+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:38:19.434286+0000","last_peered":"2023-07-29T16:38:19.434286+0000","last_clean":"2023-07-29T16:38:19.434286+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:38:19.434286+0000","last_undegraded":"2023-07-29T16:38:19.434286+0000","last_fullsized":"2023-07-29T16:38:19.434286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437805+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:38:19.437805+0000","last_peered":"2023-07-29T16:38:19.437805+0000","last_clean":"2023-07-29T16:38:19.437805+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:38:19.437805+0000","last_undegraded":"2023-07-29T16:38:19.437805+0000","last_fullsized":"2023-07-29T16:38:19.437805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437508+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:38:19.437508+0000","last_peered":"2023-07-29T16:38:19.437508+0000","last_clean":"2023-07-29T16:38:19.437508+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:38:19.437508+0000","last_undegraded":"2023-07-29T16:38:19.437508+0000","last_fullsized":"2023-07-29T16:38:19.437508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430926+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:38:19.430926+0000","last_peered":"2023-07-29T16:38:19.430926+0000","last_clean":"2023-07-29T16:38:19.430926+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:38:19.430926+0000","last_undegraded":"2023-07-29T16:38:19.430926+0000","last_fullsized":"2023-07-29T16:38:19.430926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433965+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:38:19.433965+0000","last_peered":"2023-07-29T16:38:19.433965+0000","last_clean":"2023-07-29T16:38:19.433965+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:38:19.433965+0000","last_undegraded":"2023-07-29T16:38:19.433965+0000","last_fullsized":"2023-07-29T16:38:19.433965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430576+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:38:19.430576+0000","last_peered":"2023-07-29T16:38:19.430576+0000","last_clean":"2023-07-29T16:38:19.430576+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:38:19.430576+0000","last_undegraded":"2023-07-29T16:38:19.430576+0000","last_fullsized":"2023-07-29T16:38:19.430576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431522+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:38:19.431522+0000","last_peered":"2023-07-29T16:38:19.431522+0000","last_clean":"2023-07-29T16:38:19.431522+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:38:19.431522+0000","last_undegraded":"2023-07-29T16:38:19.431522+0000","last_fullsized":"2023-07-29T16:38:19.431522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434427+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:38:19.434427+0000","last_peered":"2023-07-29T16:38:19.434427+0000","last_clean":"2023-07-29T16:38:19.434427+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:38:19.434427+0000","last_undegraded":"2023-07-29T16:38:19.434427+0000","last_fullsized":"2023-07-29T16:38:19.434427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438242+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:38:19.438242+0000","last_peered":"2023-07-29T16:38:19.438242+0000","last_clean":"2023-07-29T16:38:19.438242+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:38:19.438242+0000","last_undegraded":"2023-07-29T16:38:19.438242+0000","last_fullsized":"2023-07-29T16:38:19.438242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430725+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:38:19.430725+0000","last_peered":"2023-07-29T16:38:19.430725+0000","last_clean":"2023-07-29T16:38:19.430725+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:38:19.430725+0000","last_undegraded":"2023-07-29T16:38:19.430725+0000","last_fullsized":"2023-07-29T16:38:19.430725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431066+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:38:19.431066+0000","last_peered":"2023-07-29T16:38:19.431066+0000","last_clean":"2023-07-29T16:38:19.431066+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:38:19.431066+0000","last_undegraded":"2023-07-29T16:38:19.431066+0000","last_fullsized":"2023-07-29T16:38:19.431066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434050+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:38:19.434050+0000","last_peered":"2023-07-29T16:38:19.434050+0000","last_clean":"2023-07-29T16:38:19.434050+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:38:19.434050+0000","last_undegraded":"2023-07-29T16:38:19.434050+0000","last_fullsized":"2023-07-29T16:38:19.434050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434562+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:38:19.434562+0000","last_peered":"2023-07-29T16:38:19.434562+0000","last_clean":"2023-07-29T16:38:19.434562+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:38:19.434562+0000","last_undegraded":"2023-07-29T16:38:19.434562+0000","last_fullsized":"2023-07-29T16:38:19.434562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433659+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:38:19.433659+0000","last_peered":"2023-07-29T16:38:19.433659+0000","last_clean":"2023-07-29T16:38:19.433659+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:38:19.433659+0000","last_undegraded":"2023-07-29T16:38:19.433659+0000","last_fullsized":"2023-07-29T16:38:19.433659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431504+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:38:19.431504+0000","last_peered":"2023-07-29T16:38:19.431504+0000","last_clean":"2023-07-29T16:38:19.431504+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:38:19.431504+0000","last_undegraded":"2023-07-29T16:38:19.431504+0000","last_fullsized":"2023-07-29T16:38:19.431504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435196+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:38:19.435196+0000","last_peered":"2023-07-29T16:38:19.435196+0000","last_clean":"2023-07-29T16:38:19.435196+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:38:19.435196+0000","last_undegraded":"2023-07-29T16:38:19.435196+0000","last_fullsized":"2023-07-29T16:38:19.435196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433687+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:38:19.433687+0000","last_peered":"2023-07-29T16:38:19.433687+0000","last_clean":"2023-07-29T16:38:19.433687+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:38:19.433687+0000","last_undegraded":"2023-07-29T16:38:19.433687+0000","last_fullsized":"2023-07-29T16:38:19.433687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437660+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:38:19.437660+0000","last_peered":"2023-07-29T16:38:19.437660+0000","last_clean":"2023-07-29T16:38:19.437660+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:38:19.437660+0000","last_undegraded":"2023-07-29T16:38:19.437660+0000","last_fullsized":"2023-07-29T16:38:19.437660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434198+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:38:19.434198+0000","last_peered":"2023-07-29T16:38:19.434198+0000","last_clean":"2023-07-29T16:38:19.434198+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:38:19.434198+0000","last_undegraded":"2023-07-29T16:38:19.434198+0000","last_fullsized":"2023-07-29T16:38:19.434198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431172+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:38:19.431172+0000","last_peered":"2023-07-29T16:38:19.431172+0000","last_clean":"2023-07-29T16:38:19.431172+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:38:19.431172+0000","last_undegraded":"2023-07-29T16:38:19.431172+0000","last_fullsized":"2023-07-29T16:38:19.431172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434203+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:38:19.434203+0000","last_peered":"2023-07-29T16:38:19.434203+0000","last_clean":"2023-07-29T16:38:19.434203+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:38:19.434203+0000","last_undegraded":"2023-07-29T16:38:19.434203+0000","last_fullsized":"2023-07-29T16:38:19.434203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437719+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:38:19.437719+0000","last_peered":"2023-07-29T16:38:19.437719+0000","last_clean":"2023-07-29T16:38:19.437719+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:38:19.437719+0000","last_undegraded":"2023-07-29T16:38:19.437719+0000","last_fullsized":"2023-07-29T16:38:19.437719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437346+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:38:19.437346+0000","last_peered":"2023-07-29T16:38:19.437346+0000","last_clean":"2023-07-29T16:38:19.437346+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:38:19.437346+0000","last_undegraded":"2023-07-29T16:38:19.437346+0000","last_fullsized":"2023-07-29T16:38:19.437346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437294+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:38:19.437294+0000","last_peered":"2023-07-29T16:38:19.437294+0000","last_clean":"2023-07-29T16:38:19.437294+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:38:19.437294+0000","last_undegraded":"2023-07-29T16:38:19.437294+0000","last_fullsized":"2023-07-29T16:38:19.437294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430845+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:38:19.430845+0000","last_peered":"2023-07-29T16:38:19.430845+0000","last_clean":"2023-07-29T16:38:19.430845+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:38:19.430845+0000","last_undegraded":"2023-07-29T16:38:19.430845+0000","last_fullsized":"2023-07-29T16:38:19.430845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434551+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:38:19.434551+0000","last_peered":"2023-07-29T16:38:19.434551+0000","last_clean":"2023-07-29T16:38:19.434551+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:38:19.434551+0000","last_undegraded":"2023-07-29T16:38:19.434551+0000","last_fullsized":"2023-07-29T16:38:19.434551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431152+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:38:19.431152+0000","last_peered":"2023-07-29T16:38:19.431152+0000","last_clean":"2023-07-29T16:38:19.431152+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:38:19.431152+0000","last_undegraded":"2023-07-29T16:38:19.431152+0000","last_fullsized":"2023-07-29T16:38:19.431152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430813+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:38:19.430813+0000","last_peered":"2023-07-29T16:38:19.430813+0000","last_clean":"2023-07-29T16:38:19.430813+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:38:19.430813+0000","last_undegraded":"2023-07-29T16:38:19.430813+0000","last_fullsized":"2023-07-29T16:38:19.430813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434721+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:38:19.434721+0000","last_peered":"2023-07-29T16:38:19.434721+0000","last_clean":"2023-07-29T16:38:19.434721+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:38:19.434721+0000","last_undegraded":"2023-07-29T16:38:19.434721+0000","last_fullsized":"2023-07-29T16:38:19.434721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437071+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:38:19.437071+0000","last_peered":"2023-07-29T16:38:19.437071+0000","last_clean":"2023-07-29T16:38:19.437071+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:38:19.437071+0000","last_undegraded":"2023-07-29T16:38:19.437071+0000","last_fullsized":"2023-07-29T16:38:19.437071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435334+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:38:19.435334+0000","last_peered":"2023-07-29T16:38:19.435334+0000","last_clean":"2023-07-29T16:38:19.435334+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:38:19.435334+0000","last_undegraded":"2023-07-29T16:38:19.435334+0000","last_fullsized":"2023-07-29T16:38:19.435334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'1028","reported_seq":1040,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.486988+0000","last_change":"2023-07-29T16:38:15.000885+0000","last_active":"2023-07-29T16:38:20.486988+0000","last_peered":"2023-07-29T16:38:20.486988+0000","last_clean":"2023-07-29T16:38:20.486988+0000","last_became_active":"2023-07-29T16:38:15.000700+0000","last_became_peered":"2023-07-29T16:38:15.000700+0000","last_unstale":"2023-07-29T16:38:20.486988+0000","last_undegraded":"2023-07-29T16:38:20.486988+0000","last_fullsized":"2023-07-29T16:38:20.486988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:28.796109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438115+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:38:19.438115+0000","last_peered":"2023-07-29T16:38:19.438115+0000","last_clean":"2023-07-29T16:38:19.438115+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:38:19.438115+0000","last_undegraded":"2023-07-29T16:38:19.438115+0000","last_fullsized":"2023-07-29T16:38:19.438115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430943+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:38:19.430943+0000","last_peered":"2023-07-29T16:38:19.430943+0000","last_clean":"2023-07-29T16:38:19.430943+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:38:19.430943+0000","last_undegraded":"2023-07-29T16:38:19.430943+0000","last_fullsized":"2023-07-29T16:38:19.430943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"24'1039","reported_seq":1052,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.491565+0000","last_change":"2023-07-29T16:38:15.002940+0000","last_active":"2023-07-29T16:38:20.491565+0000","last_peered":"2023-07-29T16:38:20.491565+0000","last_clean":"2023-07-29T16:38:20.491565+0000","last_became_active":"2023-07-29T16:38:15.002741+0000","last_became_peered":"2023-07-29T16:38:15.002741+0000","last_unstale":"2023-07-29T16:38:20.491565+0000","last_undegraded":"2023-07-29T16:38:20.491565+0000","last_fullsized":"2023-07-29T16:38:20.491565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68091904,"num_objects":1039,"num_object_clones":0,"num_object_copies":2078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":66496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431267+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:38:19.431267+0000","last_peered":"2023-07-29T16:38:19.431267+0000","last_clean":"2023-07-29T16:38:19.431267+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:38:19.431267+0000","last_undegraded":"2023-07-29T16:38:19.431267+0000","last_fullsized":"2023-07-29T16:38:19.431267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431023+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:38:19.431023+0000","last_peered":"2023-07-29T16:38:19.431023+0000","last_clean":"2023-07-29T16:38:19.431023+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:38:19.431023+0000","last_undegraded":"2023-07-29T16:38:19.431023+0000","last_fullsized":"2023-07-29T16:38:19.431023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"24'995","reported_seq":1008,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.505028+0000","last_change":"2023-07-29T16:38:15.002847+0000","last_active":"2023-07-29T16:38:20.505028+0000","last_peered":"2023-07-29T16:38:20.505028+0000","last_clean":"2023-07-29T16:38:20.505028+0000","last_became_active":"2023-07-29T16:38:15.002520+0000","last_became_peered":"2023-07-29T16:38:15.002520+0000","last_unstale":"2023-07-29T16:38:20.505028+0000","last_undegraded":"2023-07-29T16:38:20.505028+0000","last_fullsized":"2023-07-29T16:38:20.505028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438017+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:38:19.438017+0000","last_peered":"2023-07-29T16:38:19.438017+0000","last_clean":"2023-07-29T16:38:19.438017+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:38:19.438017+0000","last_undegraded":"2023-07-29T16:38:19.438017+0000","last_fullsized":"2023-07-29T16:38:19.438017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437355+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:38:19.437355+0000","last_peered":"2023-07-29T16:38:19.437355+0000","last_clean":"2023-07-29T16:38:19.437355+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:38:19.437355+0000","last_undegraded":"2023-07-29T16:38:19.437355+0000","last_fullsized":"2023-07-29T16:38:19.437355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"24'985","reported_seq":998,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.509862+0000","last_change":"2023-07-29T16:38:15.003542+0000","last_active":"2023-07-29T16:38:20.509862+0000","last_peered":"2023-07-29T16:38:20.509862+0000","last_clean":"2023-07-29T16:38:20.509862+0000","last_became_active":"2023-07-29T16:38:15.003374+0000","last_became_peered":"2023-07-29T16:38:15.003374+0000","last_unstale":"2023-07-29T16:38:20.509862+0000","last_undegraded":"2023-07-29T16:38:20.509862+0000","last_fullsized":"2023-07-29T16:38:20.509862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":985,"log_dups_size":0,"ondisk_log_size":985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:17:50.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":985,"num_write_kb":63040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437534+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:38:19.437534+0000","last_peered":"2023-07-29T16:38:19.437534+0000","last_clean":"2023-07-29T16:38:19.437534+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:38:19.437534+0000","last_undegraded":"2023-07-29T16:38:19.437534+0000","last_fullsized":"2023-07-29T16:38:19.437534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434212+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:38:19.434212+0000","last_peered":"2023-07-29T16:38:19.434212+0000","last_clean":"2023-07-29T16:38:19.434212+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:38:19.434212+0000","last_undegraded":"2023-07-29T16:38:19.434212+0000","last_fullsized":"2023-07-29T16:38:19.434212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'1015","reported_seq":1028,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504879+0000","last_change":"2023-07-29T16:38:15.000783+0000","last_active":"2023-07-29T16:38:20.504879+0000","last_peered":"2023-07-29T16:38:20.504879+0000","last_clean":"2023-07-29T16:38:20.504879+0000","last_became_active":"2023-07-29T16:38:15.000526+0000","last_became_peered":"2023-07-29T16:38:15.000526+0000","last_unstale":"2023-07-29T16:38:20.504879+0000","last_undegraded":"2023-07-29T16:38:20.504879+0000","last_fullsized":"2023-07-29T16:38:20.504879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:37.626808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66519040,"num_objects":1015,"num_object_clones":0,"num_object_copies":2030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":64960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434119+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:38:19.434119+0000","last_peered":"2023-07-29T16:38:19.434119+0000","last_clean":"2023-07-29T16:38:19.434119+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:38:19.434119+0000","last_undegraded":"2023-07-29T16:38:19.434119+0000","last_fullsized":"2023-07-29T16:38:19.434119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437475+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:38:19.437475+0000","last_peered":"2023-07-29T16:38:19.437475+0000","last_clean":"2023-07-29T16:38:19.437475+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:38:19.437475+0000","last_undegraded":"2023-07-29T16:38:19.437475+0000","last_fullsized":"2023-07-29T16:38:19.437475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"24'1066","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497791+0000","last_change":"2023-07-29T16:38:15.002770+0000","last_active":"2023-07-29T16:38:20.497791+0000","last_peered":"2023-07-29T16:38:20.497791+0000","last_clean":"2023-07-29T16:38:20.497791+0000","last_became_active":"2023-07-29T16:38:15.002365+0000","last_became_peered":"2023-07-29T16:38:15.002365+0000","last_unstale":"2023-07-29T16:38:20.497791+0000","last_undegraded":"2023-07-29T16:38:20.497791+0000","last_fullsized":"2023-07-29T16:38:20.497791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:31:33.326032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69861376,"num_objects":1066,"num_object_clones":0,"num_object_copies":2132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437229+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:38:19.437229+0000","last_peered":"2023-07-29T16:38:19.437229+0000","last_clean":"2023-07-29T16:38:19.437229+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:38:19.437229+0000","last_undegraded":"2023-07-29T16:38:19.437229+0000","last_fullsized":"2023-07-29T16:38:19.437229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438206+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:38:19.438206+0000","last_peered":"2023-07-29T16:38:19.438206+0000","last_clean":"2023-07-29T16:38:19.438206+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:38:19.438206+0000","last_undegraded":"2023-07-29T16:38:19.438206+0000","last_fullsized":"2023-07-29T16:38:19.438206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"24'1035","reported_seq":1048,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504907+0000","last_change":"2023-07-29T16:38:15.000922+0000","last_active":"2023-07-29T16:38:20.504907+0000","last_peered":"2023-07-29T16:38:20.504907+0000","last_clean":"2023-07-29T16:38:20.504907+0000","last_became_active":"2023-07-29T16:38:15.000713+0000","last_became_peered":"2023-07-29T16:38:15.000713+0000","last_unstale":"2023-07-29T16:38:20.504907+0000","last_undegraded":"2023-07-29T16:38:20.504907+0000","last_fullsized":"2023-07-29T16:38:20.504907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:47:48.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67829760,"num_objects":1035,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":66240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430597+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:38:19.430597+0000","last_peered":"2023-07-29T16:38:19.430597+0000","last_clean":"2023-07-29T16:38:19.430597+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:38:19.430597+0000","last_undegraded":"2023-07-29T16:38:19.430597+0000","last_fullsized":"2023-07-29T16:38:19.430597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437712+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:38:19.437712+0000","last_peered":"2023-07-29T16:38:19.437712+0000","last_clean":"2023-07-29T16:38:19.437712+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:38:19.437712+0000","last_undegraded":"2023-07-29T16:38:19.437712+0000","last_fullsized":"2023-07-29T16:38:19.437712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"24'993","reported_seq":1004,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507883+0000","last_change":"2023-07-29T16:38:15.002931+0000","last_active":"2023-07-29T16:38:20.507883+0000","last_peered":"2023-07-29T16:38:20.507883+0000","last_clean":"2023-07-29T16:38:20.507883+0000","last_became_active":"2023-07-29T16:38:15.002633+0000","last_became_peered":"2023-07-29T16:38:15.002633+0000","last_unstale":"2023-07-29T16:38:20.507883+0000","last_undegraded":"2023-07-29T16:38:20.507883+0000","last_fullsized":"2023-07-29T16:38:20.507883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:28.941722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430774+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:38:19.430774+0000","last_peered":"2023-07-29T16:38:19.430774+0000","last_clean":"2023-07-29T16:38:19.430774+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:38:19.430774+0000","last_undegraded":"2023-07-29T16:38:19.430774+0000","last_fullsized":"2023-07-29T16:38:19.430774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434825+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:38:19.434825+0000","last_peered":"2023-07-29T16:38:19.434825+0000","last_clean":"2023-07-29T16:38:19.434825+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:38:19.434825+0000","last_undegraded":"2023-07-29T16:38:19.434825+0000","last_fullsized":"2023-07-29T16:38:19.434825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"24'1068","reported_seq":1081,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497760+0000","last_change":"2023-07-29T16:38:15.002651+0000","last_active":"2023-07-29T16:38:20.497760+0000","last_peered":"2023-07-29T16:38:20.497760+0000","last_clean":"2023-07-29T16:38:20.497760+0000","last_became_active":"2023-07-29T16:38:15.002346+0000","last_became_peered":"2023-07-29T16:38:15.002346+0000","last_unstale":"2023-07-29T16:38:20.497760+0000","last_undegraded":"2023-07-29T16:38:20.497760+0000","last_fullsized":"2023-07-29T16:38:20.497760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:26:01.849953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69992448,"num_objects":1068,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434833+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:38:19.434833+0000","last_peered":"2023-07-29T16:38:19.434833+0000","last_clean":"2023-07-29T16:38:19.434833+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:38:19.434833+0000","last_undegraded":"2023-07-29T16:38:19.434833+0000","last_fullsized":"2023-07-29T16:38:19.434833+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438122+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:38:19.438122+0000","last_peered":"2023-07-29T16:38:19.438122+0000","last_clean":"2023-07-29T16:38:19.438122+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:38:19.438122+0000","last_undegraded":"2023-07-29T16:38:19.438122+0000","last_fullsized":"2023-07-29T16:38:19.438122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430818+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:38:19.430818+0000","last_peered":"2023-07-29T16:38:19.430818+0000","last_clean":"2023-07-29T16:38:19.430818+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:38:19.430818+0000","last_undegraded":"2023-07-29T16:38:19.430818+0000","last_fullsized":"2023-07-29T16:38:19.430818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"24'1048","reported_seq":1061,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497996+0000","last_change":"2023-07-29T16:38:15.002643+0000","last_active":"2023-07-29T16:38:20.497996+0000","last_peered":"2023-07-29T16:38:20.497996+0000","last_clean":"2023-07-29T16:38:20.497996+0000","last_became_active":"2023-07-29T16:38:15.002395+0000","last_became_peered":"2023-07-29T16:38:15.002395+0000","last_unstale":"2023-07-29T16:38:20.497996+0000","last_undegraded":"2023-07-29T16:38:20.497996+0000","last_fullsized":"2023-07-29T16:38:20.497996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:07:10.753410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68681728,"num_objects":1048,"num_object_clones":0,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437362+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:38:19.437362+0000","last_peered":"2023-07-29T16:38:19.437362+0000","last_clean":"2023-07-29T16:38:19.437362+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:38:19.437362+0000","last_undegraded":"2023-07-29T16:38:19.437362+0000","last_fullsized":"2023-07-29T16:38:19.437362+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437203+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:38:19.437203+0000","last_peered":"2023-07-29T16:38:19.437203+0000","last_clean":"2023-07-29T16:38:19.437203+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:38:19.437203+0000","last_undegraded":"2023-07-29T16:38:19.437203+0000","last_fullsized":"2023-07-29T16:38:19.437203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434462+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:38:19.434462+0000","last_peered":"2023-07-29T16:38:19.434462+0000","last_clean":"2023-07-29T16:38:19.434462+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:38:19.434462+0000","last_undegraded":"2023-07-29T16:38:19.434462+0000","last_fullsized":"2023-07-29T16:38:19.434462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"24'960","reported_seq":973,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.484587+0000","last_change":"2023-07-29T16:38:15.002654+0000","last_active":"2023-07-29T16:38:20.484587+0000","last_peered":"2023-07-29T16:38:20.484587+0000","last_clean":"2023-07-29T16:38:20.484587+0000","last_became_active":"2023-07-29T16:38:15.002431+0000","last_became_peered":"2023-07-29T16:38:15.002431+0000","last_unstale":"2023-07-29T16:38:20.484587+0000","last_undegraded":"2023-07-29T16:38:20.484587+0000","last_fullsized":"2023-07-29T16:38:20.484587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:18.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433883+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:38:19.433883+0000","last_peered":"2023-07-29T16:38:19.433883+0000","last_clean":"2023-07-29T16:38:19.433883+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:38:19.433883+0000","last_undegraded":"2023-07-29T16:38:19.433883+0000","last_fullsized":"2023-07-29T16:38:19.433883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430676+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:38:19.430676+0000","last_peered":"2023-07-29T16:38:19.430676+0000","last_clean":"2023-07-29T16:38:19.430676+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:38:19.430676+0000","last_undegraded":"2023-07-29T16:38:19.430676+0000","last_fullsized":"2023-07-29T16:38:19.430676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435254+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:38:19.435254+0000","last_peered":"2023-07-29T16:38:19.435254+0000","last_clean":"2023-07-29T16:38:19.435254+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:38:19.435254+0000","last_undegraded":"2023-07-29T16:38:19.435254+0000","last_fullsized":"2023-07-29T16:38:19.435254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"24'1043","reported_seq":1056,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504958+0000","last_change":"2023-07-29T16:38:15.002929+0000","last_active":"2023-07-29T16:38:20.504958+0000","last_peered":"2023-07-29T16:38:20.504958+0000","last_clean":"2023-07-29T16:38:20.504958+0000","last_became_active":"2023-07-29T16:38:15.002588+0000","last_became_peered":"2023-07-29T16:38:15.002588+0000","last_unstale":"2023-07-29T16:38:20.504958+0000","last_undegraded":"2023-07-29T16:38:20.504958+0000","last_fullsized":"2023-07-29T16:38:20.504958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:55.768262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68354048,"num_objects":1043,"num_object_clones":0,"num_object_copies":2086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":66752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437194+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:38:19.437194+0000","last_peered":"2023-07-29T16:38:19.437194+0000","last_clean":"2023-07-29T16:38:19.437194+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:38:19.437194+0000","last_undegraded":"2023-07-29T16:38:19.437194+0000","last_fullsized":"2023-07-29T16:38:19.437194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437172+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:38:19.437172+0000","last_peered":"2023-07-29T16:38:19.437172+0000","last_clean":"2023-07-29T16:38:19.437172+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:38:19.437172+0000","last_undegraded":"2023-07-29T16:38:19.437172+0000","last_fullsized":"2023-07-29T16:38:19.437172+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434120+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:38:19.434120+0000","last_peered":"2023-07-29T16:38:19.434120+0000","last_clean":"2023-07-29T16:38:19.434120+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:38:19.434120+0000","last_undegraded":"2023-07-29T16:38:19.434120+0000","last_fullsized":"2023-07-29T16:38:19.434120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438170+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:38:19.438170+0000","last_peered":"2023-07-29T16:38:19.438170+0000","last_clean":"2023-07-29T16:38:19.438170+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:38:19.438170+0000","last_undegraded":"2023-07-29T16:38:19.438170+0000","last_fullsized":"2023-07-29T16:38:19.438170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"24'992","reported_seq":1005,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.512439+0000","last_change":"2023-07-29T16:38:15.002704+0000","last_active":"2023-07-29T16:38:20.512439+0000","last_peered":"2023-07-29T16:38:20.512439+0000","last_clean":"2023-07-29T16:38:20.512439+0000","last_became_active":"2023-07-29T16:38:15.002458+0000","last_became_peered":"2023-07-29T16:38:15.002458+0000","last_unstale":"2023-07-29T16:38:20.512439+0000","last_undegraded":"2023-07-29T16:38:20.512439+0000","last_fullsized":"2023-07-29T16:38:20.512439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436944+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:38:19.436944+0000","last_peered":"2023-07-29T16:38:19.436944+0000","last_clean":"2023-07-29T16:38:19.436944+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:38:19.436944+0000","last_undegraded":"2023-07-29T16:38:19.436944+0000","last_fullsized":"2023-07-29T16:38:19.436944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434417+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:38:19.434417+0000","last_peered":"2023-07-29T16:38:19.434417+0000","last_clean":"2023-07-29T16:38:19.434417+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:38:19.434417+0000","last_undegraded":"2023-07-29T16:38:19.434417+0000","last_fullsized":"2023-07-29T16:38:19.434417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431340+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:38:19.431340+0000","last_peered":"2023-07-29T16:38:19.431340+0000","last_clean":"2023-07-29T16:38:19.431340+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:38:19.431340+0000","last_undegraded":"2023-07-29T16:38:19.431340+0000","last_fullsized":"2023-07-29T16:38:19.431340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"24'1028","reported_seq":1041,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503520+0000","last_change":"2023-07-29T16:38:15.002764+0000","last_active":"2023-07-29T16:38:20.503520+0000","last_peered":"2023-07-29T16:38:20.503520+0000","last_clean":"2023-07-29T16:38:20.503520+0000","last_became_active":"2023-07-29T16:38:15.002492+0000","last_became_peered":"2023-07-29T16:38:15.002492+0000","last_unstale":"2023-07-29T16:38:20.503520+0000","last_undegraded":"2023-07-29T16:38:20.503520+0000","last_fullsized":"2023-07-29T16:38:20.503520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431253+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:38:19.431253+0000","last_peered":"2023-07-29T16:38:19.431253+0000","last_clean":"2023-07-29T16:38:19.431253+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:38:19.431253+0000","last_undegraded":"2023-07-29T16:38:19.431253+0000","last_fullsized":"2023-07-29T16:38:19.431253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434411+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:38:19.434411+0000","last_peered":"2023-07-29T16:38:19.434411+0000","last_clean":"2023-07-29T16:38:19.434411+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:38:19.434411+0000","last_undegraded":"2023-07-29T16:38:19.434411+0000","last_fullsized":"2023-07-29T16:38:19.434411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431099+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:38:19.431099+0000","last_peered":"2023-07-29T16:38:19.431099+0000","last_clean":"2023-07-29T16:38:19.431099+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:38:19.431099+0000","last_undegraded":"2023-07-29T16:38:19.431099+0000","last_fullsized":"2023-07-29T16:38:19.431099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"24'1034","reported_seq":1047,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503077+0000","last_change":"2023-07-29T16:38:15.002836+0000","last_active":"2023-07-29T16:38:20.503077+0000","last_peered":"2023-07-29T16:38:20.503077+0000","last_clean":"2023-07-29T16:38:20.503077+0000","last_became_active":"2023-07-29T16:38:15.002549+0000","last_became_peered":"2023-07-29T16:38:15.002549+0000","last_unstale":"2023-07-29T16:38:20.503077+0000","last_undegraded":"2023-07-29T16:38:20.503077+0000","last_fullsized":"2023-07-29T16:38:20.503077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":2068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434740+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:38:19.434740+0000","last_peered":"2023-07-29T16:38:19.434740+0000","last_clean":"2023-07-29T16:38:19.434740+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:38:19.434740+0000","last_undegraded":"2023-07-29T16:38:19.434740+0000","last_fullsized":"2023-07-29T16:38:19.434740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434755+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:38:19.434755+0000","last_peered":"2023-07-29T16:38:19.434755+0000","last_clean":"2023-07-29T16:38:19.434755+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:38:19.434755+0000","last_undegraded":"2023-07-29T16:38:19.434755+0000","last_fullsized":"2023-07-29T16:38:19.434755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433598+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:38:19.433598+0000","last_peered":"2023-07-29T16:38:19.433598+0000","last_clean":"2023-07-29T16:38:19.433598+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:38:19.433598+0000","last_undegraded":"2023-07-29T16:38:19.433598+0000","last_fullsized":"2023-07-29T16:38:19.433598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"24'1075","reported_seq":1088,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507497+0000","last_change":"2023-07-29T16:38:15.003063+0000","last_active":"2023-07-29T16:38:20.507497+0000","last_peered":"2023-07-29T16:38:20.507497+0000","last_clean":"2023-07-29T16:38:20.507497+0000","last_became_active":"2023-07-29T16:38:15.002814+0000","last_became_peered":"2023-07-29T16:38:15.002814+0000","last_unstale":"2023-07-29T16:38:20.507497+0000","last_undegraded":"2023-07-29T16:38:20.507497+0000","last_fullsized":"2023-07-29T16:38:20.507497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70451200,"num_objects":1075,"num_object_clones":0,"num_object_copies":2150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":68800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438193+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:38:19.438193+0000","last_peered":"2023-07-29T16:38:19.438193+0000","last_clean":"2023-07-29T16:38:19.438193+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:38:19.438193+0000","last_undegraded":"2023-07-29T16:38:19.438193+0000","last_fullsized":"2023-07-29T16:38:19.438193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434513+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:38:19.434513+0000","last_peered":"2023-07-29T16:38:19.434513+0000","last_clean":"2023-07-29T16:38:19.434513+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:38:19.434513+0000","last_undegraded":"2023-07-29T16:38:19.434513+0000","last_fullsized":"2023-07-29T16:38:19.434513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430962+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:38:19.430962+0000","last_peered":"2023-07-29T16:38:19.430962+0000","last_clean":"2023-07-29T16:38:19.430962+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:38:19.430962+0000","last_undegraded":"2023-07-29T16:38:19.430962+0000","last_fullsized":"2023-07-29T16:38:19.430962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430891+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:38:19.430891+0000","last_peered":"2023-07-29T16:38:19.430891+0000","last_clean":"2023-07-29T16:38:19.430891+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:38:19.430891+0000","last_undegraded":"2023-07-29T16:38:19.430891+0000","last_fullsized":"2023-07-29T16:38:19.430891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431017+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:38:19.431017+0000","last_peered":"2023-07-29T16:38:19.431017+0000","last_clean":"2023-07-29T16:38:19.431017+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:38:19.431017+0000","last_undegraded":"2023-07-29T16:38:19.431017+0000","last_fullsized":"2023-07-29T16:38:19.431017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437629+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:38:19.437629+0000","last_peered":"2023-07-29T16:38:19.437629+0000","last_clean":"2023-07-29T16:38:19.437629+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:38:19.437629+0000","last_undegraded":"2023-07-29T16:38:19.437629+0000","last_fullsized":"2023-07-29T16:38:19.437629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437384+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:38:19.437384+0000","last_peered":"2023-07-29T16:38:19.437384+0000","last_clean":"2023-07-29T16:38:19.437384+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:38:19.437384+0000","last_undegraded":"2023-07-29T16:38:19.437384+0000","last_fullsized":"2023-07-29T16:38:19.437384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431332+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:38:19.431332+0000","last_peered":"2023-07-29T16:38:19.431332+0000","last_clean":"2023-07-29T16:38:19.431332+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:38:19.431332+0000","last_undegraded":"2023-07-29T16:38:19.431332+0000","last_fullsized":"2023-07-29T16:38:19.431332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437265+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:38:19.437265+0000","last_peered":"2023-07-29T16:38:19.437265+0000","last_clean":"2023-07-29T16:38:19.437265+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:38:19.437265+0000","last_undegraded":"2023-07-29T16:38:19.437265+0000","last_fullsized":"2023-07-29T16:38:19.437265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434672+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:38:19.434672+0000","last_peered":"2023-07-29T16:38:19.434672+0000","last_clean":"2023-07-29T16:38:19.434672+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:38:19.434672+0000","last_undegraded":"2023-07-29T16:38:19.434672+0000","last_fullsized":"2023-07-29T16:38:19.434672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430587+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:38:19.430587+0000","last_peered":"2023-07-29T16:38:19.430587+0000","last_clean":"2023-07-29T16:38:19.430587+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:38:19.430587+0000","last_undegraded":"2023-07-29T16:38:19.430587+0000","last_fullsized":"2023-07-29T16:38:19.430587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434909+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:38:19.434909+0000","last_peered":"2023-07-29T16:38:19.434909+0000","last_clean":"2023-07-29T16:38:19.434909+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:38:19.434909+0000","last_undegraded":"2023-07-29T16:38:19.434909+0000","last_fullsized":"2023-07-29T16:38:19.434909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437122+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:38:19.437122+0000","last_peered":"2023-07-29T16:38:19.437122+0000","last_clean":"2023-07-29T16:38:19.437122+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:38:19.437122+0000","last_undegraded":"2023-07-29T16:38:19.437122+0000","last_fullsized":"2023-07-29T16:38:19.437122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437029+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:38:19.437029+0000","last_peered":"2023-07-29T16:38:19.437029+0000","last_clean":"2023-07-29T16:38:19.437029+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:38:19.437029+0000","last_undegraded":"2023-07-29T16:38:19.437029+0000","last_fullsized":"2023-07-29T16:38:19.437029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433795+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:38:19.433795+0000","last_peered":"2023-07-29T16:38:19.433795+0000","last_clean":"2023-07-29T16:38:19.433795+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:38:19.433795+0000","last_undegraded":"2023-07-29T16:38:19.433795+0000","last_fullsized":"2023-07-29T16:38:19.433795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430905+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:38:19.430905+0000","last_peered":"2023-07-29T16:38:19.430905+0000","last_clean":"2023-07-29T16:38:19.430905+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:38:19.430905+0000","last_undegraded":"2023-07-29T16:38:19.430905+0000","last_fullsized":"2023-07-29T16:38:19.430905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434430+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:38:19.434430+0000","last_peered":"2023-07-29T16:38:19.434430+0000","last_clean":"2023-07-29T16:38:19.434430+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:38:19.434430+0000","last_undegraded":"2023-07-29T16:38:19.434430+0000","last_fullsized":"2023-07-29T16:38:19.434430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431071+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:38:19.431071+0000","last_peered":"2023-07-29T16:38:19.431071+0000","last_clean":"2023-07-29T16:38:19.431071+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:38:19.431071+0000","last_undegraded":"2023-07-29T16:38:19.431071+0000","last_fullsized":"2023-07-29T16:38:19.431071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134467584,"data_stored":2151481344,"data_compressed":10286086,"data_compressed_allocated":134467584,"data_compressed_original":2151481344,"omap_allocated":0,"internal_metadata":0},"log_size":16404,"ondisk_log_size":16404,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71532,"kb_used_data":44580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94300308,"statfs":{"total":96636764160,"available":96563515392,"internally_reserved":0,"allocated":45649920,"data_stored":726873905,"data_compressed":3473226,"data_compressed_allocated":45424640,"data_compressed_original":726794240,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67452,"kb_used_data":36404,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94304388,"statfs":{"total":96636764160,"available":96567693312,"internally_reserved":0,"allocated":37277696,"data_stored":592330171,"data_compressed":2838654,"data_compressed_allocated":37015552,"data_compressed_original":592232448,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66056,"kb_used_data":35008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94305784,"statfs":{"total":96636764160,"available":96569122816,"internally_reserved":0,"allocated":35848192,"data_stored":569327651,"data_compressed":2727652,"data_compressed_allocated":35577856,"data_compressed_original":569229312,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37736448,"data_stored":603783168,"data_compressed":2886683,"data_compressed_allocated":37736448,"data_compressed_original":603783168,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42123264,"data_stored":673972224,"data_compressed":3222189,"data_compressed_allocated":42123264,"data_compressed_original":673972224,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":54607872,"data_stored":873725952,"data_compressed":4177214,"data_compressed_allocated":54607872,"data_compressed_original":873725952,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:22.556 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-07-29T16:38:22.556 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:22.556 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T16:38:22.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:38:22.576 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:22.576 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:22.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:22.631 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:22.628+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:22.727 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:22.725+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:22.792 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:22.792 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:22.804 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:22.847 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:22.845+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:22.928 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:22.926+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 25, 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:38:21.435841+0000", 2023-07-29T16:38:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:37:40.281964+0000", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:38:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:38:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 5, 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:38:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:38:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:38:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:38:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:38:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2023-07-29T16:38:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2023-07-29T16:38:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:38:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:38:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:38:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "unique_pool_0", 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:38:13.069639+0000", 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 16, 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 16, 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 16, 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 16, 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 16, 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rados": {} 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:38:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:38:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:38:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:38:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:38:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:38:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:38:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:38:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:38:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:38:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:38:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:38:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:38:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:38:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:38:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:38:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:23.050 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:23.052 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:23.049+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:23.053 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:23.053 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:23.054 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:38:21.435841+0000', 'last_up_change': '2023-07-29T16:37:40.281964+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-07-29T16:38:13.069639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:38:23.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:23.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:23.074 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 7 16 23985 23969 213.992 176.562 0.00768185 0.00466881 2023-07-29T16:38:23.153 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:23.151+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:23.223 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:23.224 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:23.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:23.254 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:23.251+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:23.355 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:23.352+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:23.407 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:23.407 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:23.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:23.418 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-29T16:38:21.465664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1075645274,"num_objects":16428,"num_object_clones":0,"num_object_copies":32856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16428,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":16652,"num_write_kb":1053330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16600,"ondisk_log_size":16600,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":205040,"kb_used_data":115992,"kb_used_omap":0,"kb_used_meta":89024,"kb_avail":282910480,"statfs":{"total":289910292480,"available":289700331520,"internally_reserved":0,"allocated":118775808,"data_stored":1888531727,"data_compressed":9039532,"data_compressed_allocated":118018048,"data_compressed_original":1888256000,"omap_allocated":0,"internal_metadata":91160576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.467129"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431398+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:38:19.431398+0000","last_peered":"2023-07-29T16:38:19.431398+0000","last_clean":"2023-07-29T16:38:19.431398+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:38:19.431398+0000","last_undegraded":"2023-07-29T16:38:19.431398+0000","last_fullsized":"2023-07-29T16:38:19.431398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431256+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:38:19.431256+0000","last_peered":"2023-07-29T16:38:19.431256+0000","last_clean":"2023-07-29T16:38:19.431256+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:38:19.431256+0000","last_undegraded":"2023-07-29T16:38:19.431256+0000","last_fullsized":"2023-07-29T16:38:19.431256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438098+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:38:19.438098+0000","last_peered":"2023-07-29T16:38:19.438098+0000","last_clean":"2023-07-29T16:38:19.438098+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:38:19.438098+0000","last_undegraded":"2023-07-29T16:38:19.438098+0000","last_fullsized":"2023-07-29T16:38:19.438098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437879+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:38:19.437879+0000","last_peered":"2023-07-29T16:38:19.437879+0000","last_clean":"2023-07-29T16:38:19.437879+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:38:19.437879+0000","last_undegraded":"2023-07-29T16:38:19.437879+0000","last_fullsized":"2023-07-29T16:38:19.437879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430777+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:38:19.430777+0000","last_peered":"2023-07-29T16:38:19.430777+0000","last_clean":"2023-07-29T16:38:19.430777+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:38:19.430777+0000","last_undegraded":"2023-07-29T16:38:19.430777+0000","last_fullsized":"2023-07-29T16:38:19.430777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437461+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:38:19.437461+0000","last_peered":"2023-07-29T16:38:19.437461+0000","last_clean":"2023-07-29T16:38:19.437461+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:38:19.437461+0000","last_undegraded":"2023-07-29T16:38:19.437461+0000","last_fullsized":"2023-07-29T16:38:19.437461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437532+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:38:19.437532+0000","last_peered":"2023-07-29T16:38:19.437532+0000","last_clean":"2023-07-29T16:38:19.437532+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:38:19.437532+0000","last_undegraded":"2023-07-29T16:38:19.437532+0000","last_fullsized":"2023-07-29T16:38:19.437532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436968+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:38:19.436968+0000","last_peered":"2023-07-29T16:38:19.436968+0000","last_clean":"2023-07-29T16:38:19.436968+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:38:19.436968+0000","last_undegraded":"2023-07-29T16:38:19.436968+0000","last_fullsized":"2023-07-29T16:38:19.436968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434569+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:38:19.434569+0000","last_peered":"2023-07-29T16:38:19.434569+0000","last_clean":"2023-07-29T16:38:19.434569+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:38:19.434569+0000","last_undegraded":"2023-07-29T16:38:19.434569+0000","last_fullsized":"2023-07-29T16:38:19.434569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431427+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:38:19.431427+0000","last_peered":"2023-07-29T16:38:19.431427+0000","last_clean":"2023-07-29T16:38:19.431427+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:38:19.431427+0000","last_undegraded":"2023-07-29T16:38:19.431427+0000","last_fullsized":"2023-07-29T16:38:19.431427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438016+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:38:19.438016+0000","last_peered":"2023-07-29T16:38:19.438016+0000","last_clean":"2023-07-29T16:38:19.438016+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:38:19.438016+0000","last_undegraded":"2023-07-29T16:38:19.438016+0000","last_fullsized":"2023-07-29T16:38:19.438016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430751+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:38:19.430751+0000","last_peered":"2023-07-29T16:38:19.430751+0000","last_clean":"2023-07-29T16:38:19.430751+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:38:19.430751+0000","last_undegraded":"2023-07-29T16:38:19.430751+0000","last_fullsized":"2023-07-29T16:38:19.430751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431155+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:38:19.431155+0000","last_peered":"2023-07-29T16:38:19.431155+0000","last_clean":"2023-07-29T16:38:19.431155+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:38:19.431155+0000","last_undegraded":"2023-07-29T16:38:19.431155+0000","last_fullsized":"2023-07-29T16:38:19.431155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437453+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:38:19.437453+0000","last_peered":"2023-07-29T16:38:19.437453+0000","last_clean":"2023-07-29T16:38:19.437453+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:38:19.437453+0000","last_undegraded":"2023-07-29T16:38:19.437453+0000","last_fullsized":"2023-07-29T16:38:19.437453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437333+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:38:19.437333+0000","last_peered":"2023-07-29T16:38:19.437333+0000","last_clean":"2023-07-29T16:38:19.437333+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:38:19.437333+0000","last_undegraded":"2023-07-29T16:38:19.437333+0000","last_fullsized":"2023-07-29T16:38:19.437333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437211+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:38:19.437211+0000","last_peered":"2023-07-29T16:38:19.437211+0000","last_clean":"2023-07-29T16:38:19.437211+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:38:19.437211+0000","last_undegraded":"2023-07-29T16:38:19.437211+0000","last_fullsized":"2023-07-29T16:38:19.437211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434652+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:38:19.434652+0000","last_peered":"2023-07-29T16:38:19.434652+0000","last_clean":"2023-07-29T16:38:19.434652+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:38:19.434652+0000","last_undegraded":"2023-07-29T16:38:19.434652+0000","last_fullsized":"2023-07-29T16:38:19.434652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431417+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:38:19.431417+0000","last_peered":"2023-07-29T16:38:19.431417+0000","last_clean":"2023-07-29T16:38:19.431417+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:38:19.431417+0000","last_undegraded":"2023-07-29T16:38:19.431417+0000","last_fullsized":"2023-07-29T16:38:19.431417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434286+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:38:19.434286+0000","last_peered":"2023-07-29T16:38:19.434286+0000","last_clean":"2023-07-29T16:38:19.434286+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:38:19.434286+0000","last_undegraded":"2023-07-29T16:38:19.434286+0000","last_fullsized":"2023-07-29T16:38:19.434286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437805+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:38:19.437805+0000","last_peered":"2023-07-29T16:38:19.437805+0000","last_clean":"2023-07-29T16:38:19.437805+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:38:19.437805+0000","last_undegraded":"2023-07-29T16:38:19.437805+0000","last_fullsized":"2023-07-29T16:38:19.437805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437508+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:38:19.437508+0000","last_peered":"2023-07-29T16:38:19.437508+0000","last_clean":"2023-07-29T16:38:19.437508+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:38:19.437508+0000","last_undegraded":"2023-07-29T16:38:19.437508+0000","last_fullsized":"2023-07-29T16:38:19.437508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430926+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:38:19.430926+0000","last_peered":"2023-07-29T16:38:19.430926+0000","last_clean":"2023-07-29T16:38:19.430926+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:38:19.430926+0000","last_undegraded":"2023-07-29T16:38:19.430926+0000","last_fullsized":"2023-07-29T16:38:19.430926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433965+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:38:19.433965+0000","last_peered":"2023-07-29T16:38:19.433965+0000","last_clean":"2023-07-29T16:38:19.433965+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:38:19.433965+0000","last_undegraded":"2023-07-29T16:38:19.433965+0000","last_fullsized":"2023-07-29T16:38:19.433965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430576+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:38:19.430576+0000","last_peered":"2023-07-29T16:38:19.430576+0000","last_clean":"2023-07-29T16:38:19.430576+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:38:19.430576+0000","last_undegraded":"2023-07-29T16:38:19.430576+0000","last_fullsized":"2023-07-29T16:38:19.430576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431522+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:38:19.431522+0000","last_peered":"2023-07-29T16:38:19.431522+0000","last_clean":"2023-07-29T16:38:19.431522+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:38:19.431522+0000","last_undegraded":"2023-07-29T16:38:19.431522+0000","last_fullsized":"2023-07-29T16:38:19.431522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434427+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:38:19.434427+0000","last_peered":"2023-07-29T16:38:19.434427+0000","last_clean":"2023-07-29T16:38:19.434427+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:38:19.434427+0000","last_undegraded":"2023-07-29T16:38:19.434427+0000","last_fullsized":"2023-07-29T16:38:19.434427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438242+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:38:19.438242+0000","last_peered":"2023-07-29T16:38:19.438242+0000","last_clean":"2023-07-29T16:38:19.438242+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:38:19.438242+0000","last_undegraded":"2023-07-29T16:38:19.438242+0000","last_fullsized":"2023-07-29T16:38:19.438242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430725+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:38:19.430725+0000","last_peered":"2023-07-29T16:38:19.430725+0000","last_clean":"2023-07-29T16:38:19.430725+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:38:19.430725+0000","last_undegraded":"2023-07-29T16:38:19.430725+0000","last_fullsized":"2023-07-29T16:38:19.430725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431066+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:38:19.431066+0000","last_peered":"2023-07-29T16:38:19.431066+0000","last_clean":"2023-07-29T16:38:19.431066+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:38:19.431066+0000","last_undegraded":"2023-07-29T16:38:19.431066+0000","last_fullsized":"2023-07-29T16:38:19.431066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434050+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:38:19.434050+0000","last_peered":"2023-07-29T16:38:19.434050+0000","last_clean":"2023-07-29T16:38:19.434050+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:38:19.434050+0000","last_undegraded":"2023-07-29T16:38:19.434050+0000","last_fullsized":"2023-07-29T16:38:19.434050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434562+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:38:19.434562+0000","last_peered":"2023-07-29T16:38:19.434562+0000","last_clean":"2023-07-29T16:38:19.434562+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:38:19.434562+0000","last_undegraded":"2023-07-29T16:38:19.434562+0000","last_fullsized":"2023-07-29T16:38:19.434562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433659+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:38:19.433659+0000","last_peered":"2023-07-29T16:38:19.433659+0000","last_clean":"2023-07-29T16:38:19.433659+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:38:19.433659+0000","last_undegraded":"2023-07-29T16:38:19.433659+0000","last_fullsized":"2023-07-29T16:38:19.433659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431504+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:38:19.431504+0000","last_peered":"2023-07-29T16:38:19.431504+0000","last_clean":"2023-07-29T16:38:19.431504+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:38:19.431504+0000","last_undegraded":"2023-07-29T16:38:19.431504+0000","last_fullsized":"2023-07-29T16:38:19.431504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435196+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:38:19.435196+0000","last_peered":"2023-07-29T16:38:19.435196+0000","last_clean":"2023-07-29T16:38:19.435196+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:38:19.435196+0000","last_undegraded":"2023-07-29T16:38:19.435196+0000","last_fullsized":"2023-07-29T16:38:19.435196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433687+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:38:19.433687+0000","last_peered":"2023-07-29T16:38:19.433687+0000","last_clean":"2023-07-29T16:38:19.433687+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:38:19.433687+0000","last_undegraded":"2023-07-29T16:38:19.433687+0000","last_fullsized":"2023-07-29T16:38:19.433687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437660+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:38:19.437660+0000","last_peered":"2023-07-29T16:38:19.437660+0000","last_clean":"2023-07-29T16:38:19.437660+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:38:19.437660+0000","last_undegraded":"2023-07-29T16:38:19.437660+0000","last_fullsized":"2023-07-29T16:38:19.437660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434198+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:38:19.434198+0000","last_peered":"2023-07-29T16:38:19.434198+0000","last_clean":"2023-07-29T16:38:19.434198+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:38:19.434198+0000","last_undegraded":"2023-07-29T16:38:19.434198+0000","last_fullsized":"2023-07-29T16:38:19.434198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431172+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:38:19.431172+0000","last_peered":"2023-07-29T16:38:19.431172+0000","last_clean":"2023-07-29T16:38:19.431172+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:38:19.431172+0000","last_undegraded":"2023-07-29T16:38:19.431172+0000","last_fullsized":"2023-07-29T16:38:19.431172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434203+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:38:19.434203+0000","last_peered":"2023-07-29T16:38:19.434203+0000","last_clean":"2023-07-29T16:38:19.434203+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:38:19.434203+0000","last_undegraded":"2023-07-29T16:38:19.434203+0000","last_fullsized":"2023-07-29T16:38:19.434203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437719+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:38:19.437719+0000","last_peered":"2023-07-29T16:38:19.437719+0000","last_clean":"2023-07-29T16:38:19.437719+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:38:19.437719+0000","last_undegraded":"2023-07-29T16:38:19.437719+0000","last_fullsized":"2023-07-29T16:38:19.437719+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437346+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:38:19.437346+0000","last_peered":"2023-07-29T16:38:19.437346+0000","last_clean":"2023-07-29T16:38:19.437346+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:38:19.437346+0000","last_undegraded":"2023-07-29T16:38:19.437346+0000","last_fullsized":"2023-07-29T16:38:19.437346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437294+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:38:19.437294+0000","last_peered":"2023-07-29T16:38:19.437294+0000","last_clean":"2023-07-29T16:38:19.437294+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:38:19.437294+0000","last_undegraded":"2023-07-29T16:38:19.437294+0000","last_fullsized":"2023-07-29T16:38:19.437294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430845+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:38:19.430845+0000","last_peered":"2023-07-29T16:38:19.430845+0000","last_clean":"2023-07-29T16:38:19.430845+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:38:19.430845+0000","last_undegraded":"2023-07-29T16:38:19.430845+0000","last_fullsized":"2023-07-29T16:38:19.430845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434551+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:38:19.434551+0000","last_peered":"2023-07-29T16:38:19.434551+0000","last_clean":"2023-07-29T16:38:19.434551+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:38:19.434551+0000","last_undegraded":"2023-07-29T16:38:19.434551+0000","last_fullsized":"2023-07-29T16:38:19.434551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431152+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:38:19.431152+0000","last_peered":"2023-07-29T16:38:19.431152+0000","last_clean":"2023-07-29T16:38:19.431152+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:38:19.431152+0000","last_undegraded":"2023-07-29T16:38:19.431152+0000","last_fullsized":"2023-07-29T16:38:19.431152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430813+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:38:19.430813+0000","last_peered":"2023-07-29T16:38:19.430813+0000","last_clean":"2023-07-29T16:38:19.430813+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:38:19.430813+0000","last_undegraded":"2023-07-29T16:38:19.430813+0000","last_fullsized":"2023-07-29T16:38:19.430813+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434721+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:38:19.434721+0000","last_peered":"2023-07-29T16:38:19.434721+0000","last_clean":"2023-07-29T16:38:19.434721+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:38:19.434721+0000","last_undegraded":"2023-07-29T16:38:19.434721+0000","last_fullsized":"2023-07-29T16:38:19.434721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437071+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:38:19.437071+0000","last_peered":"2023-07-29T16:38:19.437071+0000","last_clean":"2023-07-29T16:38:19.437071+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:38:19.437071+0000","last_undegraded":"2023-07-29T16:38:19.437071+0000","last_fullsized":"2023-07-29T16:38:19.437071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435334+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:38:19.435334+0000","last_peered":"2023-07-29T16:38:19.435334+0000","last_clean":"2023-07-29T16:38:19.435334+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:38:19.435334+0000","last_undegraded":"2023-07-29T16:38:19.435334+0000","last_fullsized":"2023-07-29T16:38:19.435334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'1028","reported_seq":1040,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.486988+0000","last_change":"2023-07-29T16:38:15.000885+0000","last_active":"2023-07-29T16:38:20.486988+0000","last_peered":"2023-07-29T16:38:20.486988+0000","last_clean":"2023-07-29T16:38:20.486988+0000","last_became_active":"2023-07-29T16:38:15.000700+0000","last_became_peered":"2023-07-29T16:38:15.000700+0000","last_unstale":"2023-07-29T16:38:20.486988+0000","last_undegraded":"2023-07-29T16:38:20.486988+0000","last_fullsized":"2023-07-29T16:38:20.486988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:28.796109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438115+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:38:19.438115+0000","last_peered":"2023-07-29T16:38:19.438115+0000","last_clean":"2023-07-29T16:38:19.438115+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:38:19.438115+0000","last_undegraded":"2023-07-29T16:38:19.438115+0000","last_fullsized":"2023-07-29T16:38:19.438115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430943+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:38:19.430943+0000","last_peered":"2023-07-29T16:38:19.430943+0000","last_clean":"2023-07-29T16:38:19.430943+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:38:19.430943+0000","last_undegraded":"2023-07-29T16:38:19.430943+0000","last_fullsized":"2023-07-29T16:38:19.430943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"24'1039","reported_seq":1052,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.491565+0000","last_change":"2023-07-29T16:38:15.002940+0000","last_active":"2023-07-29T16:38:20.491565+0000","last_peered":"2023-07-29T16:38:20.491565+0000","last_clean":"2023-07-29T16:38:20.491565+0000","last_became_active":"2023-07-29T16:38:15.002741+0000","last_became_peered":"2023-07-29T16:38:15.002741+0000","last_unstale":"2023-07-29T16:38:20.491565+0000","last_undegraded":"2023-07-29T16:38:20.491565+0000","last_fullsized":"2023-07-29T16:38:20.491565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68091904,"num_objects":1039,"num_object_clones":0,"num_object_copies":2078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":66496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431267+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:38:19.431267+0000","last_peered":"2023-07-29T16:38:19.431267+0000","last_clean":"2023-07-29T16:38:19.431267+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:38:19.431267+0000","last_undegraded":"2023-07-29T16:38:19.431267+0000","last_fullsized":"2023-07-29T16:38:19.431267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431023+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:38:19.431023+0000","last_peered":"2023-07-29T16:38:19.431023+0000","last_clean":"2023-07-29T16:38:19.431023+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:38:19.431023+0000","last_undegraded":"2023-07-29T16:38:19.431023+0000","last_fullsized":"2023-07-29T16:38:19.431023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"24'995","reported_seq":1008,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.505028+0000","last_change":"2023-07-29T16:38:15.002847+0000","last_active":"2023-07-29T16:38:20.505028+0000","last_peered":"2023-07-29T16:38:20.505028+0000","last_clean":"2023-07-29T16:38:20.505028+0000","last_became_active":"2023-07-29T16:38:15.002520+0000","last_became_peered":"2023-07-29T16:38:15.002520+0000","last_unstale":"2023-07-29T16:38:20.505028+0000","last_undegraded":"2023-07-29T16:38:20.505028+0000","last_fullsized":"2023-07-29T16:38:20.505028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438017+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:38:19.438017+0000","last_peered":"2023-07-29T16:38:19.438017+0000","last_clean":"2023-07-29T16:38:19.438017+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:38:19.438017+0000","last_undegraded":"2023-07-29T16:38:19.438017+0000","last_fullsized":"2023-07-29T16:38:19.438017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437355+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:38:19.437355+0000","last_peered":"2023-07-29T16:38:19.437355+0000","last_clean":"2023-07-29T16:38:19.437355+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:38:19.437355+0000","last_undegraded":"2023-07-29T16:38:19.437355+0000","last_fullsized":"2023-07-29T16:38:19.437355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"24'985","reported_seq":998,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.509862+0000","last_change":"2023-07-29T16:38:15.003542+0000","last_active":"2023-07-29T16:38:20.509862+0000","last_peered":"2023-07-29T16:38:20.509862+0000","last_clean":"2023-07-29T16:38:20.509862+0000","last_became_active":"2023-07-29T16:38:15.003374+0000","last_became_peered":"2023-07-29T16:38:15.003374+0000","last_unstale":"2023-07-29T16:38:20.509862+0000","last_undegraded":"2023-07-29T16:38:20.509862+0000","last_fullsized":"2023-07-29T16:38:20.509862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":985,"log_dups_size":0,"ondisk_log_size":985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:17:50.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":985,"num_write_kb":63040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437534+0000","last_change":"2023-07-29T16:37:53.569463+0000","last_active":"2023-07-29T16:38:19.437534+0000","last_peered":"2023-07-29T16:38:19.437534+0000","last_clean":"2023-07-29T16:38:19.437534+0000","last_became_active":"2023-07-29T16:37:53.568640+0000","last_became_peered":"2023-07-29T16:37:53.568640+0000","last_unstale":"2023-07-29T16:38:19.437534+0000","last_undegraded":"2023-07-29T16:38:19.437534+0000","last_fullsized":"2023-07-29T16:38:19.437534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434212+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:38:19.434212+0000","last_peered":"2023-07-29T16:38:19.434212+0000","last_clean":"2023-07-29T16:38:19.434212+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:38:19.434212+0000","last_undegraded":"2023-07-29T16:38:19.434212+0000","last_fullsized":"2023-07-29T16:38:19.434212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'1015","reported_seq":1028,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504879+0000","last_change":"2023-07-29T16:38:15.000783+0000","last_active":"2023-07-29T16:38:20.504879+0000","last_peered":"2023-07-29T16:38:20.504879+0000","last_clean":"2023-07-29T16:38:20.504879+0000","last_became_active":"2023-07-29T16:38:15.000526+0000","last_became_peered":"2023-07-29T16:38:15.000526+0000","last_unstale":"2023-07-29T16:38:20.504879+0000","last_undegraded":"2023-07-29T16:38:20.504879+0000","last_fullsized":"2023-07-29T16:38:20.504879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:37.626808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66519040,"num_objects":1015,"num_object_clones":0,"num_object_copies":2030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":64960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434119+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:38:19.434119+0000","last_peered":"2023-07-29T16:38:19.434119+0000","last_clean":"2023-07-29T16:38:19.434119+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:38:19.434119+0000","last_undegraded":"2023-07-29T16:38:19.434119+0000","last_fullsized":"2023-07-29T16:38:19.434119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437475+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:38:19.437475+0000","last_peered":"2023-07-29T16:38:19.437475+0000","last_clean":"2023-07-29T16:38:19.437475+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:38:19.437475+0000","last_undegraded":"2023-07-29T16:38:19.437475+0000","last_fullsized":"2023-07-29T16:38:19.437475+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"24'1066","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497791+0000","last_change":"2023-07-29T16:38:15.002770+0000","last_active":"2023-07-29T16:38:20.497791+0000","last_peered":"2023-07-29T16:38:20.497791+0000","last_clean":"2023-07-29T16:38:20.497791+0000","last_became_active":"2023-07-29T16:38:15.002365+0000","last_became_peered":"2023-07-29T16:38:15.002365+0000","last_unstale":"2023-07-29T16:38:20.497791+0000","last_undegraded":"2023-07-29T16:38:20.497791+0000","last_fullsized":"2023-07-29T16:38:20.497791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:31:33.326032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69861376,"num_objects":1066,"num_object_clones":0,"num_object_copies":2132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437229+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:38:19.437229+0000","last_peered":"2023-07-29T16:38:19.437229+0000","last_clean":"2023-07-29T16:38:19.437229+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:38:19.437229+0000","last_undegraded":"2023-07-29T16:38:19.437229+0000","last_fullsized":"2023-07-29T16:38:19.437229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438206+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:38:19.438206+0000","last_peered":"2023-07-29T16:38:19.438206+0000","last_clean":"2023-07-29T16:38:19.438206+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:38:19.438206+0000","last_undegraded":"2023-07-29T16:38:19.438206+0000","last_fullsized":"2023-07-29T16:38:19.438206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"24'1035","reported_seq":1048,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504907+0000","last_change":"2023-07-29T16:38:15.000922+0000","last_active":"2023-07-29T16:38:20.504907+0000","last_peered":"2023-07-29T16:38:20.504907+0000","last_clean":"2023-07-29T16:38:20.504907+0000","last_became_active":"2023-07-29T16:38:15.000713+0000","last_became_peered":"2023-07-29T16:38:15.000713+0000","last_unstale":"2023-07-29T16:38:20.504907+0000","last_undegraded":"2023-07-29T16:38:20.504907+0000","last_fullsized":"2023-07-29T16:38:20.504907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:47:48.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67829760,"num_objects":1035,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":66240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430597+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:38:19.430597+0000","last_peered":"2023-07-29T16:38:19.430597+0000","last_clean":"2023-07-29T16:38:19.430597+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:38:19.430597+0000","last_undegraded":"2023-07-29T16:38:19.430597+0000","last_fullsized":"2023-07-29T16:38:19.430597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437712+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:38:19.437712+0000","last_peered":"2023-07-29T16:38:19.437712+0000","last_clean":"2023-07-29T16:38:19.437712+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:38:19.437712+0000","last_undegraded":"2023-07-29T16:38:19.437712+0000","last_fullsized":"2023-07-29T16:38:19.437712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"24'993","reported_seq":1004,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507883+0000","last_change":"2023-07-29T16:38:15.002931+0000","last_active":"2023-07-29T16:38:20.507883+0000","last_peered":"2023-07-29T16:38:20.507883+0000","last_clean":"2023-07-29T16:38:20.507883+0000","last_became_active":"2023-07-29T16:38:15.002633+0000","last_became_peered":"2023-07-29T16:38:15.002633+0000","last_unstale":"2023-07-29T16:38:20.507883+0000","last_undegraded":"2023-07-29T16:38:20.507883+0000","last_fullsized":"2023-07-29T16:38:20.507883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:28.941722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430774+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:38:19.430774+0000","last_peered":"2023-07-29T16:38:19.430774+0000","last_clean":"2023-07-29T16:38:19.430774+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:38:19.430774+0000","last_undegraded":"2023-07-29T16:38:19.430774+0000","last_fullsized":"2023-07-29T16:38:19.430774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434825+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:38:19.434825+0000","last_peered":"2023-07-29T16:38:19.434825+0000","last_clean":"2023-07-29T16:38:19.434825+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:38:19.434825+0000","last_undegraded":"2023-07-29T16:38:19.434825+0000","last_fullsized":"2023-07-29T16:38:19.434825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"24'1068","reported_seq":1081,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497760+0000","last_change":"2023-07-29T16:38:15.002651+0000","last_active":"2023-07-29T16:38:20.497760+0000","last_peered":"2023-07-29T16:38:20.497760+0000","last_clean":"2023-07-29T16:38:20.497760+0000","last_became_active":"2023-07-29T16:38:15.002346+0000","last_became_peered":"2023-07-29T16:38:15.002346+0000","last_unstale":"2023-07-29T16:38:20.497760+0000","last_undegraded":"2023-07-29T16:38:20.497760+0000","last_fullsized":"2023-07-29T16:38:20.497760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:26:01.849953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69992448,"num_objects":1068,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434833+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:38:19.434833+0000","last_peered":"2023-07-29T16:38:19.434833+0000","last_clean":"2023-07-29T16:38:19.434833+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:38:19.434833+0000","last_undegraded":"2023-07-29T16:38:19.434833+0000","last_fullsized":"2023-07-29T16:38:19.434833+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438122+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:38:19.438122+0000","last_peered":"2023-07-29T16:38:19.438122+0000","last_clean":"2023-07-29T16:38:19.438122+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:38:19.438122+0000","last_undegraded":"2023-07-29T16:38:19.438122+0000","last_fullsized":"2023-07-29T16:38:19.438122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430818+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:38:19.430818+0000","last_peered":"2023-07-29T16:38:19.430818+0000","last_clean":"2023-07-29T16:38:19.430818+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:38:19.430818+0000","last_undegraded":"2023-07-29T16:38:19.430818+0000","last_fullsized":"2023-07-29T16:38:19.430818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"24'1048","reported_seq":1061,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.497996+0000","last_change":"2023-07-29T16:38:15.002643+0000","last_active":"2023-07-29T16:38:20.497996+0000","last_peered":"2023-07-29T16:38:20.497996+0000","last_clean":"2023-07-29T16:38:20.497996+0000","last_became_active":"2023-07-29T16:38:15.002395+0000","last_became_peered":"2023-07-29T16:38:15.002395+0000","last_unstale":"2023-07-29T16:38:20.497996+0000","last_undegraded":"2023-07-29T16:38:20.497996+0000","last_fullsized":"2023-07-29T16:38:20.497996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:07:10.753410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68681728,"num_objects":1048,"num_object_clones":0,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437362+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:38:19.437362+0000","last_peered":"2023-07-29T16:38:19.437362+0000","last_clean":"2023-07-29T16:38:19.437362+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:38:19.437362+0000","last_undegraded":"2023-07-29T16:38:19.437362+0000","last_fullsized":"2023-07-29T16:38:19.437362+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437203+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:38:19.437203+0000","last_peered":"2023-07-29T16:38:19.437203+0000","last_clean":"2023-07-29T16:38:19.437203+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:38:19.437203+0000","last_undegraded":"2023-07-29T16:38:19.437203+0000","last_fullsized":"2023-07-29T16:38:19.437203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434462+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:38:19.434462+0000","last_peered":"2023-07-29T16:38:19.434462+0000","last_clean":"2023-07-29T16:38:19.434462+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:38:19.434462+0000","last_undegraded":"2023-07-29T16:38:19.434462+0000","last_fullsized":"2023-07-29T16:38:19.434462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"24'960","reported_seq":973,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.484587+0000","last_change":"2023-07-29T16:38:15.002654+0000","last_active":"2023-07-29T16:38:20.484587+0000","last_peered":"2023-07-29T16:38:20.484587+0000","last_clean":"2023-07-29T16:38:20.484587+0000","last_became_active":"2023-07-29T16:38:15.002431+0000","last_became_peered":"2023-07-29T16:38:15.002431+0000","last_unstale":"2023-07-29T16:38:20.484587+0000","last_undegraded":"2023-07-29T16:38:20.484587+0000","last_fullsized":"2023-07-29T16:38:20.484587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:18.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433883+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:38:19.433883+0000","last_peered":"2023-07-29T16:38:19.433883+0000","last_clean":"2023-07-29T16:38:19.433883+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:38:19.433883+0000","last_undegraded":"2023-07-29T16:38:19.433883+0000","last_fullsized":"2023-07-29T16:38:19.433883+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430676+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:38:19.430676+0000","last_peered":"2023-07-29T16:38:19.430676+0000","last_clean":"2023-07-29T16:38:19.430676+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:38:19.430676+0000","last_undegraded":"2023-07-29T16:38:19.430676+0000","last_fullsized":"2023-07-29T16:38:19.430676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.435254+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:38:19.435254+0000","last_peered":"2023-07-29T16:38:19.435254+0000","last_clean":"2023-07-29T16:38:19.435254+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:38:19.435254+0000","last_undegraded":"2023-07-29T16:38:19.435254+0000","last_fullsized":"2023-07-29T16:38:19.435254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"24'1043","reported_seq":1056,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.504958+0000","last_change":"2023-07-29T16:38:15.002929+0000","last_active":"2023-07-29T16:38:20.504958+0000","last_peered":"2023-07-29T16:38:20.504958+0000","last_clean":"2023-07-29T16:38:20.504958+0000","last_became_active":"2023-07-29T16:38:15.002588+0000","last_became_peered":"2023-07-29T16:38:15.002588+0000","last_unstale":"2023-07-29T16:38:20.504958+0000","last_undegraded":"2023-07-29T16:38:20.504958+0000","last_fullsized":"2023-07-29T16:38:20.504958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:55.768262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68354048,"num_objects":1043,"num_object_clones":0,"num_object_copies":2086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1043,"num_write_kb":66752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437194+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:38:19.437194+0000","last_peered":"2023-07-29T16:38:19.437194+0000","last_clean":"2023-07-29T16:38:19.437194+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:38:19.437194+0000","last_undegraded":"2023-07-29T16:38:19.437194+0000","last_fullsized":"2023-07-29T16:38:19.437194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437172+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:38:19.437172+0000","last_peered":"2023-07-29T16:38:19.437172+0000","last_clean":"2023-07-29T16:38:19.437172+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:38:19.437172+0000","last_undegraded":"2023-07-29T16:38:19.437172+0000","last_fullsized":"2023-07-29T16:38:19.437172+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434120+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:38:19.434120+0000","last_peered":"2023-07-29T16:38:19.434120+0000","last_clean":"2023-07-29T16:38:19.434120+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:38:19.434120+0000","last_undegraded":"2023-07-29T16:38:19.434120+0000","last_fullsized":"2023-07-29T16:38:19.434120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438170+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:38:19.438170+0000","last_peered":"2023-07-29T16:38:19.438170+0000","last_clean":"2023-07-29T16:38:19.438170+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:38:19.438170+0000","last_undegraded":"2023-07-29T16:38:19.438170+0000","last_fullsized":"2023-07-29T16:38:19.438170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"24'992","reported_seq":1005,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.512439+0000","last_change":"2023-07-29T16:38:15.002704+0000","last_active":"2023-07-29T16:38:20.512439+0000","last_peered":"2023-07-29T16:38:20.512439+0000","last_clean":"2023-07-29T16:38:20.512439+0000","last_became_active":"2023-07-29T16:38:15.002458+0000","last_became_peered":"2023-07-29T16:38:15.002458+0000","last_unstale":"2023-07-29T16:38:20.512439+0000","last_undegraded":"2023-07-29T16:38:20.512439+0000","last_fullsized":"2023-07-29T16:38:20.512439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.436944+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:38:19.436944+0000","last_peered":"2023-07-29T16:38:19.436944+0000","last_clean":"2023-07-29T16:38:19.436944+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:38:19.436944+0000","last_undegraded":"2023-07-29T16:38:19.436944+0000","last_fullsized":"2023-07-29T16:38:19.436944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434417+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:38:19.434417+0000","last_peered":"2023-07-29T16:38:19.434417+0000","last_clean":"2023-07-29T16:38:19.434417+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:38:19.434417+0000","last_undegraded":"2023-07-29T16:38:19.434417+0000","last_fullsized":"2023-07-29T16:38:19.434417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431340+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:38:19.431340+0000","last_peered":"2023-07-29T16:38:19.431340+0000","last_clean":"2023-07-29T16:38:19.431340+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:38:19.431340+0000","last_undegraded":"2023-07-29T16:38:19.431340+0000","last_fullsized":"2023-07-29T16:38:19.431340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"24'1028","reported_seq":1041,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503520+0000","last_change":"2023-07-29T16:38:15.002764+0000","last_active":"2023-07-29T16:38:20.503520+0000","last_peered":"2023-07-29T16:38:20.503520+0000","last_clean":"2023-07-29T16:38:20.503520+0000","last_became_active":"2023-07-29T16:38:15.002492+0000","last_became_peered":"2023-07-29T16:38:15.002492+0000","last_unstale":"2023-07-29T16:38:20.503520+0000","last_undegraded":"2023-07-29T16:38:20.503520+0000","last_fullsized":"2023-07-29T16:38:20.503520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431253+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:38:19.431253+0000","last_peered":"2023-07-29T16:38:19.431253+0000","last_clean":"2023-07-29T16:38:19.431253+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:38:19.431253+0000","last_undegraded":"2023-07-29T16:38:19.431253+0000","last_fullsized":"2023-07-29T16:38:19.431253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434411+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:38:19.434411+0000","last_peered":"2023-07-29T16:38:19.434411+0000","last_clean":"2023-07-29T16:38:19.434411+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:38:19.434411+0000","last_undegraded":"2023-07-29T16:38:19.434411+0000","last_fullsized":"2023-07-29T16:38:19.434411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431099+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:38:19.431099+0000","last_peered":"2023-07-29T16:38:19.431099+0000","last_clean":"2023-07-29T16:38:19.431099+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:38:19.431099+0000","last_undegraded":"2023-07-29T16:38:19.431099+0000","last_fullsized":"2023-07-29T16:38:19.431099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"24'1034","reported_seq":1047,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.503077+0000","last_change":"2023-07-29T16:38:15.002836+0000","last_active":"2023-07-29T16:38:20.503077+0000","last_peered":"2023-07-29T16:38:20.503077+0000","last_clean":"2023-07-29T16:38:20.503077+0000","last_became_active":"2023-07-29T16:38:15.002549+0000","last_became_peered":"2023-07-29T16:38:15.002549+0000","last_unstale":"2023-07-29T16:38:20.503077+0000","last_undegraded":"2023-07-29T16:38:20.503077+0000","last_fullsized":"2023-07-29T16:38:20.503077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":2068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434740+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:38:19.434740+0000","last_peered":"2023-07-29T16:38:19.434740+0000","last_clean":"2023-07-29T16:38:19.434740+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:38:19.434740+0000","last_undegraded":"2023-07-29T16:38:19.434740+0000","last_fullsized":"2023-07-29T16:38:19.434740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434755+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:38:19.434755+0000","last_peered":"2023-07-29T16:38:19.434755+0000","last_clean":"2023-07-29T16:38:19.434755+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:38:19.434755+0000","last_undegraded":"2023-07-29T16:38:19.434755+0000","last_fullsized":"2023-07-29T16:38:19.434755+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433598+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:38:19.433598+0000","last_peered":"2023-07-29T16:38:19.433598+0000","last_clean":"2023-07-29T16:38:19.433598+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:38:19.433598+0000","last_undegraded":"2023-07-29T16:38:19.433598+0000","last_fullsized":"2023-07-29T16:38:19.433598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"24'1075","reported_seq":1088,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T16:38:20.507497+0000","last_change":"2023-07-29T16:38:15.003063+0000","last_active":"2023-07-29T16:38:20.507497+0000","last_peered":"2023-07-29T16:38:20.507497+0000","last_clean":"2023-07-29T16:38:20.507497+0000","last_became_active":"2023-07-29T16:38:15.002814+0000","last_became_peered":"2023-07-29T16:38:15.002814+0000","last_unstale":"2023-07-29T16:38:20.507497+0000","last_undegraded":"2023-07-29T16:38:20.507497+0000","last_fullsized":"2023-07-29T16:38:20.507497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70451200,"num_objects":1075,"num_object_clones":0,"num_object_copies":2150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":68800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.438193+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:38:19.438193+0000","last_peered":"2023-07-29T16:38:19.438193+0000","last_clean":"2023-07-29T16:38:19.438193+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:38:19.438193+0000","last_undegraded":"2023-07-29T16:38:19.438193+0000","last_fullsized":"2023-07-29T16:38:19.438193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434513+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:38:19.434513+0000","last_peered":"2023-07-29T16:38:19.434513+0000","last_clean":"2023-07-29T16:38:19.434513+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:38:19.434513+0000","last_undegraded":"2023-07-29T16:38:19.434513+0000","last_fullsized":"2023-07-29T16:38:19.434513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430962+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:38:19.430962+0000","last_peered":"2023-07-29T16:38:19.430962+0000","last_clean":"2023-07-29T16:38:19.430962+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:38:19.430962+0000","last_undegraded":"2023-07-29T16:38:19.430962+0000","last_fullsized":"2023-07-29T16:38:19.430962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430891+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:38:19.430891+0000","last_peered":"2023-07-29T16:38:19.430891+0000","last_clean":"2023-07-29T16:38:19.430891+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:38:19.430891+0000","last_undegraded":"2023-07-29T16:38:19.430891+0000","last_fullsized":"2023-07-29T16:38:19.430891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431017+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:38:19.431017+0000","last_peered":"2023-07-29T16:38:19.431017+0000","last_clean":"2023-07-29T16:38:19.431017+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:38:19.431017+0000","last_undegraded":"2023-07-29T16:38:19.431017+0000","last_fullsized":"2023-07-29T16:38:19.431017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437629+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:38:19.437629+0000","last_peered":"2023-07-29T16:38:19.437629+0000","last_clean":"2023-07-29T16:38:19.437629+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:38:19.437629+0000","last_undegraded":"2023-07-29T16:38:19.437629+0000","last_fullsized":"2023-07-29T16:38:19.437629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437384+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:38:19.437384+0000","last_peered":"2023-07-29T16:38:19.437384+0000","last_clean":"2023-07-29T16:38:19.437384+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:38:19.437384+0000","last_undegraded":"2023-07-29T16:38:19.437384+0000","last_fullsized":"2023-07-29T16:38:19.437384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431332+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:38:19.431332+0000","last_peered":"2023-07-29T16:38:19.431332+0000","last_clean":"2023-07-29T16:38:19.431332+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:38:19.431332+0000","last_undegraded":"2023-07-29T16:38:19.431332+0000","last_fullsized":"2023-07-29T16:38:19.431332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437265+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:38:19.437265+0000","last_peered":"2023-07-29T16:38:19.437265+0000","last_clean":"2023-07-29T16:38:19.437265+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:38:19.437265+0000","last_undegraded":"2023-07-29T16:38:19.437265+0000","last_fullsized":"2023-07-29T16:38:19.437265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434672+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:38:19.434672+0000","last_peered":"2023-07-29T16:38:19.434672+0000","last_clean":"2023-07-29T16:38:19.434672+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:38:19.434672+0000","last_undegraded":"2023-07-29T16:38:19.434672+0000","last_fullsized":"2023-07-29T16:38:19.434672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430587+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:38:19.430587+0000","last_peered":"2023-07-29T16:38:19.430587+0000","last_clean":"2023-07-29T16:38:19.430587+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:38:19.430587+0000","last_undegraded":"2023-07-29T16:38:19.430587+0000","last_fullsized":"2023-07-29T16:38:19.430587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434909+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:38:19.434909+0000","last_peered":"2023-07-29T16:38:19.434909+0000","last_clean":"2023-07-29T16:38:19.434909+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:38:19.434909+0000","last_undegraded":"2023-07-29T16:38:19.434909+0000","last_fullsized":"2023-07-29T16:38:19.434909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437122+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:38:19.437122+0000","last_peered":"2023-07-29T16:38:19.437122+0000","last_clean":"2023-07-29T16:38:19.437122+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:38:19.437122+0000","last_undegraded":"2023-07-29T16:38:19.437122+0000","last_fullsized":"2023-07-29T16:38:19.437122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.437029+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:38:19.437029+0000","last_peered":"2023-07-29T16:38:19.437029+0000","last_clean":"2023-07-29T16:38:19.437029+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:38:19.437029+0000","last_undegraded":"2023-07-29T16:38:19.437029+0000","last_fullsized":"2023-07-29T16:38:19.437029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.433795+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:38:19.433795+0000","last_peered":"2023-07-29T16:38:19.433795+0000","last_clean":"2023-07-29T16:38:19.433795+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:38:19.433795+0000","last_undegraded":"2023-07-29T16:38:19.433795+0000","last_fullsized":"2023-07-29T16:38:19.433795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.430905+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:38:19.430905+0000","last_peered":"2023-07-29T16:38:19.430905+0000","last_clean":"2023-07-29T16:38:19.430905+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:38:19.430905+0000","last_undegraded":"2023-07-29T16:38:19.430905+0000","last_fullsized":"2023-07-29T16:38:19.430905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.434430+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:38:19.434430+0000","last_peered":"2023-07-29T16:38:19.434430+0000","last_clean":"2023-07-29T16:38:19.434430+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:38:19.434430+0000","last_undegraded":"2023-07-29T16:38:19.434430+0000","last_fullsized":"2023-07-29T16:38:19.434430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-29T16:38:19.431071+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:38:19.431071+0000","last_peered":"2023-07-29T16:38:19.431071+0000","last_clean":"2023-07-29T16:38:19.431071+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:38:19.431071+0000","last_undegraded":"2023-07-29T16:38:19.431071+0000","last_fullsized":"2023-07-29T16:38:19.431071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1075052544,"num_objects":16404,"num_object_clones":0,"num_object_copies":32808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16404,"num_write_kb":1049856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134467584,"data_stored":2151481344,"data_compressed":10286086,"data_compressed_allocated":134467584,"data_compressed_original":2151481344,"omap_allocated":0,"internal_metadata":0},"log_size":16404,"ondisk_log_size":16404,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71532,"kb_used_data":44580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94300308,"statfs":{"total":96636764160,"available":96563515392,"internally_reserved":0,"allocated":45649920,"data_stored":726873905,"data_compressed":3473226,"data_compressed_allocated":45424640,"data_compressed_original":726794240,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67452,"kb_used_data":36404,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94304388,"statfs":{"total":96636764160,"available":96567693312,"internally_reserved":0,"allocated":37277696,"data_stored":592330171,"data_compressed":2838654,"data_compressed_allocated":37015552,"data_compressed_original":592232448,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66056,"kb_used_data":35008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94305784,"statfs":{"total":96636764160,"available":96569122816,"internally_reserved":0,"allocated":35848192,"data_stored":569327651,"data_compressed":2727652,"data_compressed_allocated":35577856,"data_compressed_original":569229312,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37736448,"data_stored":603783168,"data_compressed":2886683,"data_compressed_allocated":37736448,"data_compressed_original":603783168,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42123264,"data_stored":673972224,"data_compressed":3222189,"data_compressed_allocated":42123264,"data_compressed_original":673972224,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":54607872,"data_stored":873725952,"data_compressed":4177214,"data_compressed_allocated":54607872,"data_compressed_original":873725952,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:23.424 INFO:tasks.thrashosds.thrasher:Setting 3.c to [0, 2] 2023-07-29T16:38:23.425 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.c', '0', '2'] 2023-07-29T16:38:23.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.c 0 2 2023-07-29T16:38:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:38:23.458 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:23.456+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:23.556 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:23.554+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:23.635 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:23.636 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:23.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:23.658 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:23.655+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:23.758 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:23.756+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:23.823 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:23.823 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:23.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:23.859 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:23.856+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:23.960 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:23.957+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:24.013 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:24.014 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:24.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:24.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:24.061 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:24.058+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:24.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 8 16 26731 26715 208.694 171.625 0.00795894 0.00478827 2023-07-29T16:38:24.162 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:24.160+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:24.167 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:24.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:24.204 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:24.204 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:24.207 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:24.208 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:24.209 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:24.209 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:24.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:24.263 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:24.261+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:24.364 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:24.361+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:24.382 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27489 5.b 5:d9494d94:::benchmark_data_smithi070_97781_object27488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.375687+0000", 2023-07-29T16:38:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0050460089999999997, 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050652090000000002, 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27489 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375687+0000", 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375687+0000", 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375687+0000", 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375795+0000", 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010844999999999999 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375809+0000", 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4041e-05 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375823+0000", 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4059999999999999e-05 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375855+0000", 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1921999999999997e-05 2023-07-29T16:38:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375936+0000", 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0915999999999996e-05 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.376033+0000", 2023-07-29T16:38:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6967999999999997e-05 2023-07-29T16:38:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.377023+0000", 2023-07-29T16:38:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0009903449999999999 2023-07-29T16:38:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27492 5.4 5:2862c8d0:::benchmark_data_smithi070_97781_object27491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.375834+0000", 2023-07-29T16:38:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0048991779999999997, 2023-07-29T16:38:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049712289999999998, 2023-07-29T16:38:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27492 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375834+0000", 2023-07-29T16:38:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375834+0000", 2023-07-29T16:38:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375834+0000", 2023-07-29T16:38:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375968+0000", 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000134017 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375978+0000", 2023-07-29T16:38:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0455000000000001e-05 2023-07-29T16:38:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.375985+0000", 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1969999999999999e-06 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.376015+0000", 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9767000000000001e-05 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.376092+0000", 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6812999999999998e-05 2023-07-29T16:38:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.376169+0000", 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6656000000000006e-05 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.377411+0000", 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001242841 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27493 5.b 5:d5c9473f:::benchmark_data_smithi070_97781_object27492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.378386+0000", 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0023476040000000001, 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024786389999999999, 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27493 2023-07-29T16:38:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378386+0000", 2023-07-29T16:38:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378386+0000", 2023-07-29T16:38:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378385+0000", 2023-07-29T16:38:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378492+0000", 2023-07-29T16:38:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106681 2023-07-29T16:38:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378505+0000", 2023-07-29T16:38:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2928000000000001e-05 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378512+0000", 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7819999999999994e-06 2023-07-29T16:38:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378551+0000", 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8355000000000001e-05 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378678+0000", 2023-07-29T16:38:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126861 2023-07-29T16:38:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378827+0000", 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014919999999999999 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.380844+0000", 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020169049999999998 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27496 5.4 5:2a878348:::benchmark_data_smithi070_97781_object27495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.378523+0000", 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002210395, 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023914959999999999, 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27496 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378523+0000", 2023-07-29T16:38:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378523+0000", 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378523+0000", 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378616+0000", 2023-07-29T16:38:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3381000000000006e-05 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378628+0000", 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2063e-05 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378635+0000", 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0979999999999996e-06 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378665+0000", 2023-07-29T16:38:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.008e-05 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378743+0000", 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7539000000000004e-05 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378822+0000", 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9332000000000005e-05 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.380028+0000", 2023-07-29T16:38:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012057229999999999 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27499 5.b 5:d0bcbdf4:::benchmark_data_smithi070_97781_object27498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.378652+0000", 2023-07-29T16:38:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002081963, 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023164100000000001, 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27499 2023-07-29T16:38:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378652+0000", 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378652+0000", 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378651+0000", 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378759+0000", 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108329 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378769+0000", 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4040000000000001e-06 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.378776+0000", 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9770000000000003e-06 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379746+0000", 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097050399999999996 2023-07-29T16:38:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379890+0000", 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014355999999999999 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.380052+0000", 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162335 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:27498 5.a e26/19 5:55cb7ff8:::benchmark_data_smithi070_97781_object27497:head v 26'1660, mlcod=26'1658)", 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.379096+0000", 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0016378720000000001, 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019526400000000001, 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379096+0000", 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379096+0000", 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379095+0000", 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379165+0000", 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9692999999999998e-05 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379176+0000", 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1562999999999999e-05 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379184+0000", 2023-07-29T16:38:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6240000000000002e-06 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379210+0000", 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6143e-05 2023-07-29T16:38:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.379224+0000", 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3994e-05 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:27489 5.b e26/19 ondisk, result = 0)", 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.381051+0000", 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9996829, 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9237000000000002e-05, 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381051+0000", 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381051+0000", 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381050+0000", 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381053+0000", 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2989999999999999e-06 2023-07-29T16:38:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381057+0000", 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5630000000000002e-06 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381060+0000", 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9170000000000002e-06 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381088+0000", 2023-07-29T16:38:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7951999999999999e-05 2023-07-29T16:38:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.381093+0000", 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8509999999999998e-06 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:38:24.449 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:24.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:24.461 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.c pg_upmap mapping to [0,2] 2023-07-29T16:38:24.466 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:24.463+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:24.566 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:24.563+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:24.654 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:24.656 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:24.667 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:24.665+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:24.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:24.768 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:24.765+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:24.869 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:24.867+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.874 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.923150593999999, 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:24.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:24.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:24.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:24.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:24.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:24.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922849609, 2023-07-29T16:38:24.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:24.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:24.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:24.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:24.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:24.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:24.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:24.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.897 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:24.898 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922816855000001, 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:24.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:24.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:24.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:24.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:24.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:24.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:24.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:24.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:24.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:24.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:24.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:24.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:24.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:24.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:24.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:24.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:24.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922785974, 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:24.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:24.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:24.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:24.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:24.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:24.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:24.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:24.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:24.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:24.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922764604000001, 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:24.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:24.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:24.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:24.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:24.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:24.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:24.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:24.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:24.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:24.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:24.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:24.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:24.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:24.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:24.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:24.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:24.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:24.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:24.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:24.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:24.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:24.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922730158, 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:24.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:24.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:24.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:24.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:24.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:24.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922708481000001, 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:24.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922230103, 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:24.973 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:24.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:24.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:24.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:24.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.922190784000001, 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012841247, 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:24.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948270+0000", 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948282+0000", 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948292+0000", 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1570000000000006e-06 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948300+0000", 2023-07-29T16:38:24.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3189999999999995e-06 2023-07-29T16:38:24.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948961+0000", 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066065600000000003 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948982+0000", 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1588999999999999e-05 2023-07-29T16:38:24.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953445+0000", 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044624970000000002 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953666+0000", 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022092699999999999 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961112+0000", 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074460000000000004 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:15911 5.0 5:06027f99:::benchmark_data_smithi070_97781_object15910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.5287145500000001, 2023-07-29T16:38:24.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012899693, 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15911 2023-07-29T16:38:24.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341747+0000", 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341746+0000", 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:24.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:24.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341786+0000", 2023-07-29T16:38:24.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0212000000000001e-05 2023-07-29T16:38:24.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:24.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341798+0000", 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1574e-05 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341804+0000", 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8589999999999999e-06 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341853+0000", 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8674999999999997e-05 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:24.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:24.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.341975+0000", 2023-07-29T16:38:24.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012234999999999999 2023-07-29T16:38:24.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.342129+0000", 2023-07-29T16:38:25.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153647 2023-07-29T16:38:25.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.343867+0000", 2023-07-29T16:38:25.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017379629999999999 2023-07-29T16:38:25.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354539+0000", 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010671579 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354603+0000", 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4343000000000004e-05 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:20.354646+0000", 2023-07-29T16:38:25.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3297000000000002e-05 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:19447 5.e 5:7f3455ed:::benchmark_data_smithi070_97781_object19446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:25.005 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3859395399999999, 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013269820999999999, 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.006 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 19447 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484521+0000", 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484569+0000", 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7759999999999997e-05 2023-07-29T16:38:25.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484573+0000", 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-06 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484578+0000", 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2549999999999999e-06 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488274+0000", 2023-07-29T16:38:25.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003696478 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488365+0000", 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1156999999999995e-05 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488460+0000", 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4406000000000004e-05 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.490701+0000", 2023-07-29T16:38:25.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022413450000000001 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497719+0000", 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070178089999999999 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497759+0000", 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9830000000000003e-05 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497791+0000", 2023-07-29T16:38:25.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2787000000000003e-05 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:19449 5.e 5:75473936:::benchmark_data_smithi070_97781_object19448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:21.485222+0000", 2023-07-29T16:38:25.016 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3852394380000002, 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012647403, 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 19449 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485222+0000", 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485222+0000", 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485221+0000", 2023-07-29T16:38:25.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485321+0000", 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9358000000000007e-05 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485331+0000", 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0322999999999999e-05 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485339+0000", 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7039999999999994e-06 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.489186+0000", 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846941 2023-07-29T16:38:25.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.489260+0000", 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4178999999999996e-05 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.489340+0000", 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9977999999999999e-05 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.491813+0000", 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002473509 2023-07-29T16:38:25.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497798+0000", 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059852550000000001 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497839+0000", 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0896000000000003e-05 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497869+0000", 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9773000000000001e-05 2023-07-29T16:38:25.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:19450 5.e 5:77306055:::benchmark_data_smithi070_97781_object19449:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:21.485346+0000", 2023-07-29T16:38:25.027 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3851150489999999, 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012596435, 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 19450 2023-07-29T16:38:25.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485346+0000", 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485346+0000", 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485345+0000", 2023-07-29T16:38:25.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485376+0000", 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0737000000000001e-05 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485383+0000", 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0530000000000001e-06 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.485389+0000", 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8710000000000002e-06 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.489822+0000", 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044333280000000003 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.489895+0000", 2023-07-29T16:38:25.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2145999999999997e-05 2023-07-29T16:38:25.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.490022+0000", 2023-07-29T16:38:25.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012773400000000001 2023-07-29T16:38:25.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.491887+0000", 2023-07-29T16:38:25.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018647620000000001 2023-07-29T16:38:25.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497874+0000", 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870779999999998 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497912+0000", 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8284000000000001e-05 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497943+0000", 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0154999999999998e-05 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27091 5.0 5:06593b22:::benchmark_data_smithi070_97781_object27090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.220064+0000", 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.65039749300000005, 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012563591000000001, 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.041 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27091 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220064+0000", 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220064+0000", 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220063+0000", 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220091+0000", 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7827999999999999e-05 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220150+0000", 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9123999999999998e-05 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220159+0000", 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2480000000000002e-06 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220226+0000", 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6829999999999995e-05 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220319+0000", 2023-07-29T16:38:25.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3315999999999999e-05 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.220438+0000", 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119381 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.222258+0000", 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018196 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.232534+0000", 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010275918 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.232584+0000", 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9548000000000001e-05 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.232627+0000", 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3726000000000001e-05 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.052 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.052 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:25.052 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.35514282200000002, 2023-07-29T16:38:25.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:25.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.054 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.054 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:25.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.055 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:25.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:25.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:25.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:25.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:25.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:25.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27884 5.e 5:7df06602:::benchmark_data_smithi070_97781_object27883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.354821626, 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015390623000000001, 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27884 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515639+0000", 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515693+0000", 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515702+0000", 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8009999999999998e-06 2023-07-29T16:38:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515708+0000", 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6500000000000001e-06 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516811+0000", 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011030370000000001 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516934+0000", 2023-07-29T16:38:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517091+0000", 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015713000000000001 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520518+0000", 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034265049999999998 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530982+0000", 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010464141 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531011+0000", 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-05 2023-07-29T16:38:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531030+0000", 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9394000000000001e-05 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27886 5.e 5:7783bbaa:::benchmark_data_smithi070_97781_object27885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.35457936600000001, 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015423605999999999, 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27886 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515881+0000", 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515909+0000", 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8283999999999999e-05 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515915+0000", 2023-07-29T16:38:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515919+0000", 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9060000000000004e-06 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517921+0000", 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002002078 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518055+0000", 2023-07-29T16:38:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013362000000000001 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518215+0000", 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015999800000000001 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520523+0000", 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023083040000000002 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531225+0000", 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701657 2023-07-29T16:38:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531269+0000", 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4561999999999998e-05 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531305+0000", 2023-07-29T16:38:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6035000000000003e-05 2023-07-29T16:38:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27960 5.4 5:28ef3e07:::benchmark_data_smithi070_97781_object27959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.549220+0000", 2023-07-29T16:38:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.32124072300000001, 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012454049, 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27960 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549220+0000", 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549220+0000", 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549220+0000", 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549364+0000", 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143805 2023-07-29T16:38:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549374+0000", 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0618999999999999e-05 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.549381+0000", 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.002e-06 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.551698+0000", 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023171250000000002 2023-07-29T16:38:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.551814+0000", 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115838 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.551962+0000", 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148061 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.553301+0000", 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001339114 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.561607+0000", 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083056390000000001 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.561644+0000", 2023-07-29T16:38:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6915000000000001e-05 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.561674+0000", 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0451e-05 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28366 5.d 5:b96c5390:::benchmark_data_smithi070_97781_object28365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.167486529, 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013232514000000001, 2023-07-29T16:38:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28366 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702974+0000", 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703035+0000", 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1043000000000005e-05 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703040+0000", 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0950000000000003e-06 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703044+0000", 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.664e-06 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703071+0000", 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7168000000000001e-05 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703158+0000", 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6519000000000003e-05 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703258+0000", 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010045800000000001 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.709139+0000", 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058810659999999999 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716124+0000", 2023-07-29T16:38:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069846939999999996 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716170+0000", 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6354999999999999e-05 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716207+0000", 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6780999999999999e-05 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.068672398999999995, 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:25.123 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:25.124 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 9 16 29334 29318 203.581 162.688 0.00725242 0.0049077 2023-07-29T16:38:25.124 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:25.121+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:25.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:25.225 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:25.223+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:25.298 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:25.298 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:29912 5.7 5:e0b22322:::benchmark_data_smithi070_97781_object29911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.294796+0000", 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0015304019999999999, 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00154904, 2023-07-29T16:38:25.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.300 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:25.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.300 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.300 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29912 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294796+0000", 2023-07-29T16:38:25.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294796+0000", 2023-07-29T16:38:25.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294791+0000", 2023-07-29T16:38:25.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999957 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294881+0000", 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9679000000000007e-05 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294889+0000", 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1589999999999993e-06 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294895+0000", 2023-07-29T16:38:25.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0460000000000002e-06 2023-07-29T16:38:25.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.295397+0000", 2023-07-29T16:38:25.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00050182000000000004 2023-07-29T16:38:25.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.295520+0000", 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123108 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.295666+0000", 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014631600000000001 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:29901 5.2 5:4f2ddf41:::benchmark_data_smithi070_97781_object29900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.293123+0000", 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0032030600000000002, 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032741390000000001, 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:25.310 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29901 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293123+0000", 2023-07-29T16:38:25.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293123+0000", 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293122+0000", 2023-07-29T16:38:25.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293178+0000", 2023-07-29T16:38:25.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6075000000000001e-05 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293187+0000", 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9760000000000001e-06 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293193+0000", 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2379999999999997e-06 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293240+0000", 2023-07-29T16:38:25.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7629000000000001e-05 2023-07-29T16:38:25.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293361+0000", 2023-07-29T16:38:25.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000120679 2023-07-29T16:38:25.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293447+0000", 2023-07-29T16:38:25.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5916999999999997e-05 2023-07-29T16:38:25.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294633+0000", 2023-07-29T16:38:25.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011862719999999999 2023-07-29T16:38:25.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.321 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.322 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:29905 5.7 5:ef6dc9b2:::benchmark_data_smithi070_97781_object29904:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.322 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.293689+0000", 2023-07-29T16:38:25.323 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0026366219999999999, 2023-07-29T16:38:25.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027546659999999998, 2023-07-29T16:38:25.323 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.324 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:25.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29905 2023-07-29T16:38:25.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.325 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293689+0000", 2023-07-29T16:38:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293689+0000", 2023-07-29T16:38:25.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293689+0000", 2023-07-29T16:38:25.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:25.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293713+0000", 2023-07-29T16:38:25.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4859e-05 2023-07-29T16:38:25.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293723+0000", 2023-07-29T16:38:25.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8230000000000006e-06 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293730+0000", 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0330000000000003e-06 2023-07-29T16:38:25.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293782+0000", 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1211999999999997e-05 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.293940+0000", 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015801300000000001 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294084+0000", 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014403800000000001 2023-07-29T16:38:25.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:29911 5.1 5:8125099d:::benchmark_data_smithi070_97781_object29910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.335 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.294634+0000", 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00169174, 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018578990000000001, 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 29911 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294634+0000", 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294634+0000", 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294634+0000", 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294679+0000", 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5355999999999997e-05 2023-07-29T16:38:25.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294694+0000", 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5443000000000001e-05 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294702+0000", 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9580000000000007e-06 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294764+0000", 2023-07-29T16:38:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1426000000000004e-05 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294880+0000", 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116152 2023-07-29T16:38:25.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294971+0000", 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.145e-05 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.296368+0000", 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001396642 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:29908 5.c e27/19 5:3b56b608:::benchmark_data_smithi070_97781_object29907:head v 27'1928, mlcod=27'1926)", 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.294745+0000", 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001580971, 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001810407, 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:25.345 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294745+0000", 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294745+0000", 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294745+0000", 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294816+0000", 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1668000000000006e-05 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294826+0000", 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3009999999999995e-06 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294831+0000", 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7389999999999996e-06 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294872+0000", 2023-07-29T16:38:25.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0776999999999999e-05 2023-07-29T16:38:25.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.294892+0000", 2023-07-29T16:38:25.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.035e-05 2023-07-29T16:38:25.352 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.352 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.352 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.353 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:25.353 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 5 2023-07-29T16:38:25.353 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:25.355 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:25.353+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:25.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:25.456 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:25.454+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:25.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:38:25.530 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:25.531 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:25.531 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:25.531 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:25.531 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:25.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:25.556 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:25.554+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:25.657 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:25.654+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:25.750 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:25.751 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:25.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:25.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:25.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.751 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 43.225608559000001, 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:25.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:25.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:25.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:25.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.763 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800725394000001, 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015080049999999999, 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946371+0000", 2023-07-29T16:38:25.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946369+0000", 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:25.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946378+0000", 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8060000000000001e-06 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946389+0000", 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1250000000000001e-05 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946402+0000", 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2143e-05 2023-07-29T16:38:25.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948774+0000", 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023720920000000001 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:25.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948780+0000", 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8680000000000004e-06 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952342+0000", 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035620199999999999 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952751+0000", 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040939399999999999 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.952906+0000", 2023-07-29T16:38:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000154776 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958270+0000", 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053643049999999998 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961358+0000", 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030884549999999999 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961411+0000", 2023-07-29T16:38:25.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2608999999999997e-05 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961451+0000", 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9889999999999999e-05 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.774 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800679508000002, 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015461422000000001, 2023-07-29T16:38:25.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946417+0000", 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946416+0000", 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946421+0000", 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7140000000000001e-06 2023-07-29T16:38:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946428+0000", 2023-07-29T16:38:25.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2660000000000004e-06 2023-07-29T16:38:25.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946438+0000", 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0284e-05 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949297+0000", 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028585070000000001 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949308+0000", 2023-07-29T16:38:25.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1445e-05 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953255+0000", 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039465510000000004 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953337+0000", 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1692000000000003e-05 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.953490+0000", 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015321900000000001 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958277+0000", 2023-07-29T16:38:25.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047871550000000004 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961774+0000", 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00349672 2023-07-29T16:38:25.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961837+0000", 2023-07-29T16:38:25.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2967999999999997e-05 2023-07-29T16:38:25.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961878+0000", 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1591000000000002e-05 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800651578, 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:25.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:25.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:25.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:25.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.798 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800626723000001, 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:25.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:25.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:25.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:25.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:25.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800594779000001, 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:25.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:25.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:25.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:25.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.821 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800573168, 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:25.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:25.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:25.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:25.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:25.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800549107999998, 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.833 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:25.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:25.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:25.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.80051396, 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.844 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:25.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:25.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.854 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800477846, 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:25.855 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:25.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:25.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:25.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:25.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.866 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800452943, 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:25.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:25.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:25.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800397969999999, 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800330653, 2023-07-29T16:38:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800305733999998, 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800254191000001, 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800230243000001, 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016589201000000001, 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946869+0000", 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946880+0000", 2023-07-29T16:38:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0614e-05 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946885+0000", 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6469999999999997e-06 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948666+0000", 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001781384 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948670+0000", 2023-07-29T16:38:25.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9720000000000003e-06 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954685+0000", 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060152510000000001 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954828+0000", 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014298100000000001 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955312+0000", 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048344000000000002 2023-07-29T16:38:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958247+0000", 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029349749999999998 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963305+0000", 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050582989999999996 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963411+0000", 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106001 2023-07-29T16:38:25.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963455+0000", 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4478999999999999e-05 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800206607, 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.934 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:25.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:25.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:25.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.800183320999999, 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.945 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:25.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:25.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:25.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:30364 5.2 5:4619a269:::benchmark_data_smithi070_97781_object30363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.457213+0000", 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.289883632, 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013706405, 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.954 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 30364 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457213+0000", 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457213+0000", 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457212+0000", 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457277+0000", 2023-07-29T16:38:25.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5059000000000002e-05 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457282+0000", 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8709999999999996e-06 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.457286+0000", 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.473e-06 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.461557+0000", 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042708729999999997 2023-07-29T16:38:25.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.461712+0000", 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000154971 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.461879+0000", 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016775500000000001 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.468482+0000", 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066028279999999998 2023-07-29T16:38:25.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.470845+0000", 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002362524 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.470885+0000", 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9969000000000003e-05 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.470919+0000", 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4439e-05 2023-07-29T16:38:25.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:30367 5.2 5:45fe7824:::benchmark_data_smithi070_97781_object30366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.459750+0000", 2023-07-29T16:38:25.964 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.28734629499999997, 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.014773835000000001, 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 30367 2023-07-29T16:38:25.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459750+0000", 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459750+0000", 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459749+0000", 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459816+0000", 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6550000000000005e-05 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459822+0000", 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2650000000000002e-06 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.459827+0000", 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4989999999999996e-06 2023-07-29T16:38:25.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.465021+0000", 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051945059999999998 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.465107+0000", 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.577e-05 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.465197+0000", 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0111999999999994e-05 2023-07-29T16:38:25.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.468844+0000", 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0036469559999999998 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:25.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.474464+0000", 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056199939999999997 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.474493+0000", 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8544999999999999e-05 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:25.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.474524+0000", 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1191e-05 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:25.974 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:25.975 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:25.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:25.977 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:25.973+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:26.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 10 15 31976 31961 199.74 165.188 0.00567839 0.00500319 2023-07-29T16:38:26.076 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:26.073+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:26.165 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32192 5.b e28/19 5:d6df635e:::benchmark_data_smithi070_97781_object32191:head v 28'2059, mlcod=28'2055)", 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.157845+0000", 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0043029050000000001, 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043269559999999999, 2023-07-29T16:38:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157845+0000", 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157845+0000", 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157844+0000", 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157934+0000", 2023-07-29T16:38:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9905000000000001e-05 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157943+0000", 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9439999999999994e-06 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157949+0000", 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9649999999999996e-06 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.157994+0000", 2023-07-29T16:38:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5043999999999998e-05 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.158014+0000", 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0063000000000001e-05 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:32196 5.a 5:5eea6eef:::benchmark_data_smithi070_97781_object32195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.158934+0000", 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0032131569999999999, 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033120580000000001, 2023-07-29T16:38:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 32196 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.158934+0000", 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.158934+0000", 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.158932+0000", 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999981 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159053+0000", 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120821 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159065+0000", 2023-07-29T16:38:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2257e-05 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159072+0000", 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.302e-06 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159132+0000", 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159221+0000", 2023-07-29T16:38:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9036999999999995e-05 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159349+0000", 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161531+0000", 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00218177 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:32202 5.a 5:5783e080:::benchmark_data_smithi070_97781_object32201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.159242+0000", 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002905445, 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003099526, 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 32202 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159242+0000", 2023-07-29T16:38:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159242+0000", 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159241+0000", 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159384+0000", 2023-07-29T16:38:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014284399999999999 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159393+0000", 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3720000000000005e-06 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159402+0000", 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4620000000000002e-06 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160063+0000", 2023-07-29T16:38:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000661329 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160222+0000", 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015825999999999999 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160382+0000", 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016029099999999999 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161948+0000", 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001565915 2023-07-29T16:38:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32193 5.4 e28/19 5:2cbdde39:::benchmark_data_smithi070_97781_object32192:head v 28'2042, mlcod=28'2040)", 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.159693+0000", 2023-07-29T16:38:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024543809999999998, 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002733989, 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159693+0000", 2023-07-29T16:38:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159693+0000", 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159693+0000", 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159732+0000", 2023-07-29T16:38:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8829999999999999e-05 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159743+0000", 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0981999999999999e-05 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159749+0000", 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5490000000000003e-06 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159782+0000", 2023-07-29T16:38:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3308e-05 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159796+0000", 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3414000000000001e-05 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32198 5.0 e28/19 5:0e701c43:::benchmark_data_smithi070_97781_object32197:head v 28'2040, mlcod=28'2038)", 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.159760+0000", 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0023873050000000002, 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027495039999999998, 2023-07-29T16:38:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159760+0000", 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159760+0000", 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159760+0000", 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159791+0000", 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1337000000000002e-05 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159799+0000", 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8380000000000002e-06 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159805+0000", 2023-07-29T16:38:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9599999999999997e-06 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159842+0000", 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6850000000000001e-05 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159860+0000", 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7963000000000001e-05 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.203 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32203 5.8 e28/19 5:1bf4bd47:::benchmark_data_smithi070_97781_object32202:head v 28'1992, mlcod=28'1990)", 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.159920+0000", 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0022272680000000001, 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026562090000000001, 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159920+0000", 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159920+0000", 2023-07-29T16:38:26.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159920+0000", 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159977+0000", 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6823000000000001e-05 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159988+0000", 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1837e-05 2023-07-29T16:38:26.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.159997+0000", 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2099999999999993e-06 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160034+0000", 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7839999999999997e-05 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160053+0000", 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8541000000000001e-05 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.209 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32194 5.1 e28/19 5:81f30e9b:::benchmark_data_smithi070_97781_object32193:head v 28'2053, mlcod=28'2050)", 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.160348+0000", 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0017998599999999999, 2023-07-29T16:38:26.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022979609999999998, 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160348+0000", 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160348+0000", 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160347+0000", 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160413+0000", 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5526999999999998e-05 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160422+0000", 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1279999999999997e-06 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160429+0000", 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1389999999999998e-06 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160589+0000", 2023-07-29T16:38:26.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015976900000000001 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160609+0000", 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0245e-05 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.216 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32195 5.2 e28/19 5:41026318:::benchmark_data_smithi070_97781_object32194:head v 28'2017, mlcod=28'2015)", 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.160442+0000", 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0017057190000000001, 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022696999999999999, 2023-07-29T16:38:26.217 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160442+0000", 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160442+0000", 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160441+0000", 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160477+0000", 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5286000000000001e-05 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160484+0000", 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3540000000000002e-06 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160490+0000", 2023-07-29T16:38:26.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3890000000000004e-06 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161502+0000", 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010128190000000001 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161522+0000", 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9913000000000001e-05 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32199 5.7 e28/19 5:e36e17ab:::benchmark_data_smithi070_97781_object32198:head v 28'1983, mlcod=28'1981)", 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.160495+0000", 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001652824, 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022827989999999999, 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160495+0000", 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160495+0000", 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160494+0000", 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160529+0000", 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4212999999999999e-05 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160535+0000", 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5769999999999999e-06 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160540+0000", 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7650000000000001e-06 2023-07-29T16:38:26.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160576+0000", 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5644e-05 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160593+0000", 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7472000000000001e-05 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162739+0000", 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002145685 2023-07-29T16:38:26.230 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32200 5.1 e28/19 5:85374064:::benchmark_data_smithi070_97781_object32199:head v 28'2054, mlcod=28'2051)", 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.160943+0000", 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001204529, 2023-07-29T16:38:26.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018893169999999999, 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160943+0000", 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160943+0000", 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.160942+0000", 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161004+0000", 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1915999999999995e-05 2023-07-29T16:38:26.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161013+0000", 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3920000000000003e-06 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161019+0000", 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2689999999999996e-06 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161761+0000", 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00074180000000000003 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161781+0000", 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0594e-05 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32201 5.4 e28/19 5:24a75fd6:::benchmark_data_smithi070_97781_object32200:head v 28'2043, mlcod=28'2040)", 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.161336+0000", 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000811931, 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015643530000000001, 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.238 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161336+0000", 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161336+0000", 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161335+0000", 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161364+0000", 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8887e-05 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161373+0000", 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999997e-06 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161379+0000", 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2859999999999996e-06 2023-07-29T16:38:26.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161450+0000", 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0815000000000006e-05 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161470+0000", 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9890000000000001e-05 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.244 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32207 5.0 e28/19 5:06b909ee:::benchmark_data_smithi070_97781_object32206:head v 28'2041, mlcod=28'2038)", 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.161885+0000", 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00026215899999999998, 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010825909999999999, 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161885+0000", 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161885+0000", 2023-07-29T16:38:26.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161885+0000", 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161937+0000", 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.24e-05 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161947+0000", 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3209999999999994e-06 2023-07-29T16:38:26.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.161953+0000", 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8939999999999998e-06 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162000+0000", 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7522999999999999e-05 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162017+0000", 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6796e-05 2023-07-29T16:38:26.250 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32208 5.4 e28/19 5:24029cc6:::benchmark_data_smithi070_97781_object32207:head v 28'2044, mlcod=28'2040)", 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.162175+0000", 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999728, 2023-07-29T16:38:26.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085791399999999999, 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162175+0000", 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162175+0000", 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162174+0000", 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162235+0000", 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0649999999999997e-05 2023-07-29T16:38:26.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162243+0000", 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.371e-06 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162250+0000", 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000004e-06 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162450+0000", 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020012799999999999 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162467+0000", 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7359000000000001e-05 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32206 5.1 e28/19 5:8c474368:::benchmark_data_smithi070_97781_object32205:head v 28'2055, mlcod=28'2051)", 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.162747+0000", 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9994006, 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034964799999999998, 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162747+0000", 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162747+0000", 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162747+0000", 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162814+0000", 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7144000000000006e-05 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162820+0000", 2023-07-29T16:38:26.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2049999999999999e-06 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162825+0000", 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.831e-06 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162858+0000", 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3575999999999998e-05 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.162878+0000", 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9673e-05 2023-07-29T16:38:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:32210 5.7 e28/19 5:ed6205d8:::benchmark_data_smithi070_97781_object32209:head v 28'1984, mlcod=28'1981)", 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:26.163007+0000", 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9991403, 2023-07-29T16:38:26.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000155585, 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163007+0000", 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163007+0000", 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:26.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163007+0000", 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163061+0000", 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4602999999999999e-05 2023-07-29T16:38:26.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163070+0000", 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4819999999999994e-06 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:26.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163075+0000", 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0989999999999998e-06 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163110+0000", 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4836999999999999e-05 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:26.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:26.163129+0000", 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9392999999999999e-05 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:26.270 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:26.271 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2023-07-29T16:38:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:26.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:26.273 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:26.269+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:26.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:26.373 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:26.370+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:26.423 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:26.445 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:26.469 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:38:26.470 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:26.473 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:26.472+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:26.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:26.574 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:26.571+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:26.674 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:26.673+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:26.686 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:26.686 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:26.696 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:26.776 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:26.774+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:26.866 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:26.867 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:26.877 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:26.874+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:26.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:26.978 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:26.975+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:27.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 11 16 34445 34429 195.603 154.25 0.00876181 0.00510888 2023-07-29T16:38:27.078 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.076+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:27.091 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:27.091 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:27.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:27.179 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.177+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:27.280 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:27.277+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:27.299 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:27.299 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:27.312 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:27.380 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:27.378+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:27.471 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:27.472 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:27.481 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.479+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:27.486 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:27.582 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:27.580+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:27.683 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:27.680+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:27.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:27.784 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.782+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:27.885 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.883+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:27.919 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:27.919 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:27.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:27.985 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:27.983+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:28.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 12 16 36784 36768 191.484 146.188 0.00581998 0.00521845 2023-07-29T16:38:28.086 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:28.084+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:28.119 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:28.119 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:28.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:28.219 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:28.217+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:28.288 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:28.286+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:28.365 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:28.366 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:28.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:28.390 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:28.387+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:28.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:38:28.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:28.490 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:28.487+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:28.590 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:28.588+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:28.592 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:28.592 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:28.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:28.637 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:28.657 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:28.678 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:28.679 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:28.679 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:28.679 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:28.691 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:28.689+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:28.774 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38480 5.0 5:0c664cc3:::benchmark_data_smithi070_97781_object38479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.767086+0000", 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0044089109999999997, 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044297829999999996, 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38480 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767086+0000", 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767086+0000", 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767085+0000", 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767149+0000", 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3095999999999994e-05 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767157+0000", 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1470000000000001e-06 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767161+0000", 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4739999999999999e-06 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767188+0000", 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6886e-05 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767281+0000", 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2539000000000003e-05 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767400+0000", 2023-07-29T16:38:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011986500000000001 2023-07-29T16:38:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38481 5.d 5:b1d65223:::benchmark_data_smithi070_97781_object38480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.767274+0000", 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0042210889999999999, 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042962859999999999, 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38481 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767274+0000", 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767274+0000", 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767274+0000", 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767348+0000", 2023-07-29T16:38:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4439999999999999e-05 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767353+0000", 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5770000000000004e-06 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767356+0000", 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.523e-06 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767399+0000", 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2953e-05 2023-07-29T16:38:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767513+0000", 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011354 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767631+0000", 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011827700000000001 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38482 5.b 5:d7c3f62b:::benchmark_data_smithi070_97781_object38481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.767365+0000", 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004130295, 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042725549999999999, 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38482 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767365+0000", 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767365+0000", 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767365+0000", 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767405+0000", 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0281000000000003e-05 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767411+0000", 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6789999999999999e-06 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767417+0000", 2023-07-29T16:38:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7930000000000003e-06 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767470+0000", 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2958999999999999e-05 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767590+0000", 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119397 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767714+0000", 2023-07-29T16:38:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123938 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:38476 5.f e29/19 5:f8a4f14c:::benchmark_data_smithi070_97781_object38475:head v 29'2423, mlcod=29'2419)", 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.767452+0000", 2023-07-29T16:38:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0040431520000000004, 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004238431, 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767452+0000", 2023-07-29T16:38:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767452+0000", 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767452+0000", 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767554+0000", 2023-07-29T16:38:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010247999999999999 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767562+0000", 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7449999999999995e-06 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767568+0000", 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8860000000000001e-06 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767594+0000", 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6449999999999999e-05 2023-07-29T16:38:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.767610+0000", 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5506999999999999e-05 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38483 5.e 5:72f4030b:::benchmark_data_smithi070_97781_object38482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.768856+0000", 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0026389769999999998, 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028740419999999998, 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38483 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768856+0000", 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768856+0000", 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768856+0000", 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768917+0000", 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1820000000000001e-05 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768927+0000", 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5040000000000008e-06 2023-07-29T16:38:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768934+0000", 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9149999999999999e-06 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.768972+0000", 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8090999999999998e-05 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769079+0000", 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010723 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769171+0000", 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1961999999999998e-05 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38484 5.4 5:2483302b:::benchmark_data_smithi070_97781_object38483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.769448+0000", 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0020471270000000001, 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023500219999999998, 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38484 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769448+0000", 2023-07-29T16:38:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769448+0000", 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769448+0000", 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769494+0000", 2023-07-29T16:38:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6320999999999999e-05 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769501+0000", 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0589999999999997e-06 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769507+0000", 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.835e-06 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769532+0000", 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5225999999999999e-05 2023-07-29T16:38:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769617+0000", 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5045999999999999e-05 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769702+0000", 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5025000000000007e-05 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38487 5.8 5:118584be:::benchmark_data_smithi070_97781_object38486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.769685+0000", 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001810245, 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002218242, 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38487 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769685+0000", 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769685+0000", 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769684+0000", 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769746+0000", 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1803000000000004e-05 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769755+0000", 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2870000000000004e-06 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769759+0000", 2023-07-29T16:38:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7079999999999996e-06 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769786+0000", 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6364e-05 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769867+0000", 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0995999999999995e-05 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.769943+0000", 2023-07-29T16:38:28.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6501000000000005e-05 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38490 5.e 5:70956d0e:::benchmark_data_smithi070_97781_object38489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.771292+0000", 2023-07-29T16:38:28.828 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000203019, 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00067892099999999997, 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38490 2023-07-29T16:38:28.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771292+0000", 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771292+0000", 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771291+0000", 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:28.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771418+0000", 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012625900000000001 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771430+0000", 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2098e-05 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771436+0000", 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0970000000000002e-06 2023-07-29T16:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771468+0000", 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1658000000000001e-05 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771580+0000", 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112493 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771746+0000", 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016616299999999999 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38491 5.b 5:d2aaa91b:::benchmark_data_smithi070_97781_object38490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.771444+0000", 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.0770999999999999e-05, 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060228199999999999, 2023-07-29T16:38:28.836 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38491 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771444+0000", 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771444+0000", 2023-07-29T16:38:28.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771444+0000", 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771478+0000", 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3884999999999998e-05 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771483+0000", 2023-07-29T16:38:28.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1669999999999998e-06 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771487+0000", 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7179999999999998e-06 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771520+0000", 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2956000000000001e-05 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771637+0000", 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116871 2023-07-29T16:38:28.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771780+0000", 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014317600000000001 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:38489 5.a e29/19 5:54eeeae8:::benchmark_data_smithi070_97781_object38488:head v 29'2334, mlcod=29'2332)", 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.771709+0000", 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9997869, 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040527599999999999, 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:28.844 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771709+0000", 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771709+0000", 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771708+0000", 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771845+0000", 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013734399999999999 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771854+0000", 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4789999999999996e-06 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771860+0000", 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2339999999999999e-06 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771892+0000", 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2305000000000003e-05 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771915+0000", 2023-07-29T16:38:28.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2161999999999999e-05 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:38492 5.9 e29/19 5:9af5f0a7:::benchmark_data_smithi070_97781_object38491:head v 29'2424, mlcod=29'2422)", 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.771930+0000", 2023-07-29T16:38:28.850 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9995656, 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021667100000000001, 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771930+0000", 2023-07-29T16:38:28.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771930+0000", 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771929+0000", 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771955+0000", 2023-07-29T16:38:28.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5817999999999999e-05 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771962+0000", 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8140000000000003e-06 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.771968+0000", 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8289999999999996e-06 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772006+0000", 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8118000000000003e-05 2023-07-29T16:38:28.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772026+0000", 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9896999999999999e-05 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:38480 5.0 e29/19)", 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.772152+0000", 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9993429, 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1207000000000001e-05, 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772152+0000", 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:28.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772152+0000", 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772152+0000", 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772155+0000", 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.36e-06 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:28.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772165+0000", 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9429999999999995e-06 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.772171+0000", 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8839999999999999e-06 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 12 2023-07-29T16:38:28.862 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:28.863 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:28.864 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:28.860+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:28.964 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:28.961+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:29.065 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:29.063+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:29.069 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:29.069 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:29.069 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:29.069 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:29.069 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:29.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 13 16 39238 39222 188.552 153.375 0.00634162 0.00530017 2023-07-29T16:38:29.083 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:29.166 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:29.164+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:29.267 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:29.265+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:29.288 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.289 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337825494000001, 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:29.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337524508999998, 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.301 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:29.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:29.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:29.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:29.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337491755000002, 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:29.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:29.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:29.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:29.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337460874000001, 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:29.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:29.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:29.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:29.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337439504000002, 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.335 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:29.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:29.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:29.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:29.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:29.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:29.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:29.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:29.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.348 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.349 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.349 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:29.349 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337405058000002, 2023-07-29T16:38:29.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:29.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.350 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:29.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:29.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:29.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:29.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:29.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:29.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.337383381000002, 2023-07-29T16:38:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.336905002999998, 2023-07-29T16:38:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:19447 5.e 5:7f3455ed:::benchmark_data_smithi070_97781_object19446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8006144400000004, 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013269820999999999, 2023-07-29T16:38:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 19447 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484522+0000", 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484521+0000", 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484569+0000", 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7759999999999997e-05 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484573+0000", 2023-07-29T16:38:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-06 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.484578+0000", 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2549999999999999e-06 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488274+0000", 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003696478 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488365+0000", 2023-07-29T16:38:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1156999999999995e-05 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.488460+0000", 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4406000000000004e-05 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.490701+0000", 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022413450000000001 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497719+0000", 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070178089999999999 2023-07-29T16:38:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497759+0000", 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9830000000000003e-05 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:21.497791+0000", 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2787000000000003e-05 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.769817722, 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27884 5.e 5:7df06602:::benchmark_data_smithi070_97781_object27883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7694965260000002, 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015390623000000001, 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27884 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515639+0000", 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515693+0000", 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515702+0000", 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8009999999999998e-06 2023-07-29T16:38:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515708+0000", 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6500000000000001e-06 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516811+0000", 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011030370000000001 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516934+0000", 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517091+0000", 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015713000000000001 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520518+0000", 2023-07-29T16:38:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034265049999999998 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530982+0000", 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010464141 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531011+0000", 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-05 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531030+0000", 2023-07-29T16:38:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9394000000000001e-05 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27886 5.e 5:7783bbaa:::benchmark_data_smithi070_97781_object27885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7692542659999999, 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015423605999999999, 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27886 2023-07-29T16:38:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515881+0000", 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515909+0000", 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8283999999999999e-05 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515915+0000", 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515919+0000", 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9060000000000004e-06 2023-07-29T16:38:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517921+0000", 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002002078 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518055+0000", 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013362000000000001 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518215+0000", 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015999800000000001 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520523+0000", 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023083040000000002 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531225+0000", 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701657 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531269+0000", 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4561999999999998e-05 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531305+0000", 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6035000000000003e-05 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28366 5.d 5:b96c5390:::benchmark_data_smithi070_97781_object28365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.5821614290000001, 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013232514000000001, 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28366 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702975+0000", 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.702974+0000", 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703035+0000", 2023-07-29T16:38:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1043000000000005e-05 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703040+0000", 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0950000000000003e-06 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703044+0000", 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.664e-06 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703071+0000", 2023-07-29T16:38:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7168000000000001e-05 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703158+0000", 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6519000000000003e-05 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.703258+0000", 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010045800000000001 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.709139+0000", 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058810659999999999 2023-07-29T16:38:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716124+0000", 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069846939999999996 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716170+0000", 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6354999999999999e-05 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.716207+0000", 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6780999999999999e-05 2023-07-29T16:38:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4833472990000001, 2023-07-29T16:38:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:38718 5.e 5:7f16632c:::benchmark_data_smithi070_97781_object38717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:28.862275+0000", 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.42286119500000002, 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014009957, 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 38718 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862275+0000", 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862275+0000", 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862274+0000", 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862365+0000", 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0514999999999997e-05 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862374+0000", 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5699999999999999e-06 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.862380+0000", 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.507e-06 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.863424+0000", 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001043944 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.863529+0000", 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105553 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.863624+0000", 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4758000000000003e-05 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.867243+0000", 2023-07-29T16:38:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036192279999999999 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.876217+0000", 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089732649999999994 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.876252+0000", 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5811e-05 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:28.876285+0000", 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2469999999999999e-05 2023-07-29T16:38:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39119 5.b 5:d24c1e56:::benchmark_data_smithi070_97781_object39118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.256544842, 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015792800999999999, 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39119 2023-07-29T16:38:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028631+0000", 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0861000000000001e-05 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028657+0000", 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5624999999999999e-05 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028671+0000", 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2023-07-29T16:38:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030170+0000", 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014990820000000001 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030302+0000", 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013176900000000001 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030437+0000", 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013460600000000001 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032638+0000", 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022014700000000001 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044293+0000", 2023-07-29T16:38:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011655341 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044343+0000", 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0065000000000003e-05 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044384+0000", 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0528999999999998e-05 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39120 5.d 5:bc2291c6:::benchmark_data_smithi070_97781_object39119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.25645569000000001, 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015266223000000001, 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39120 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028712+0000", 2023-07-29T16:38:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2678000000000001e-05 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028727+0000", 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4817999999999999e-05 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028734+0000", 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0729999999999999e-06 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028770+0000", 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5618999999999999e-05 2023-07-29T16:38:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028861+0000", 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0867999999999998e-05 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028969+0000", 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108378 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032016+0000", 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030467229999999999 2023-07-29T16:38:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043860+0000", 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011843806 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043905+0000", 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5565999999999997e-05 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043947+0000", 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1304000000000003e-05 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39121 5.d 5:bce715e6:::benchmark_data_smithi070_97781_object39120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.25622689599999998, 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015107417, 2023-07-29T16:38:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39121 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028908+0000", 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028961+0000", 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2781999999999997e-05 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028973+0000", 2023-07-29T16:38:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1783000000000001e-05 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028981+0000", 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4249999999999998e-06 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030155+0000", 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011737589999999999 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030301+0000", 2023-07-29T16:38:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014600099999999999 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030466+0000", 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016504200000000001 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032852+0000", 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002385599 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043957+0000", 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011105001999999999 2023-07-29T16:38:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043995+0000", 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7954999999999998e-05 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044017+0000", 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2022999999999999e-05 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:39123 5.9 e29/19 5:95d76f6b:::benchmark_data_smithi070_97781_object39122:head v 29'2464, mlcod=29'2459)", 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.030493+0000", 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.25464339400000002, 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013418196, 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030493+0000", 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030493+0000", 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030492+0000", 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030564+0000", 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1789e-05 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030573+0000", 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9120000000000004e-06 2023-07-29T16:38:29.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030582+0000", 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.414e-06 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030686+0000", 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103886 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030701+0000", 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4477999999999999e-05 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043883+0000", 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013182434 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043911+0000", 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7793e-05 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:39125 5.f e29/19 5:f9513f7b:::benchmark_data_smithi070_97781_object39124:head v 29'2462, mlcod=29'2460)", 2023-07-29T16:38:29.509 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.030749+0000", 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.25438712899999999, 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01320897, 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:29.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030749+0000", 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030749+0000", 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030748+0000", 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030814+0000", 2023-07-29T16:38:29.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5883000000000006e-05 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030822+0000", 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9650000000000008e-06 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030827+0000", 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4510000000000002e-06 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030861+0000", 2023-07-29T16:38:29.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3745999999999998e-05 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030874+0000", 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3691e-05 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043921+0000", 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013046785999999999 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043958+0000", 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6903000000000002e-05 2023-07-29T16:38:29.516 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.517 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:29.517 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:29.517 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:29.518 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:29.518 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:29.518 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-07-29T16:38:29.518 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-07-29T16:38:29.518 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-07-29T16:38:29.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-07-29T16:38:29.520 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:29.515+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:29.521 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:38:29.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:29.619 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:29.618+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:29.696 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:29.697 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:29.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.697 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40748 5.9 5:99fd26b2:::benchmark_data_smithi070_97781_object40747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.697 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.689667+0000", 2023-07-29T16:38:29.697 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0042640320000000001, 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042898140000000003, 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40748 2023-07-29T16:38:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689667+0000", 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689667+0000", 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689666+0000", 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689743+0000", 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6398999999999998e-05 2023-07-29T16:38:29.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689761+0000", 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8607999999999999e-05 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689769+0000", 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5179999999999998e-06 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689807+0000", 2023-07-29T16:38:29.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8152999999999999e-05 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689927+0000", 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012003 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690058+0000", 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013140800000000001 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692619+0000", 2023-07-29T16:38:29.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025610310000000001 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.706 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40751 5.1 5:874281b3:::benchmark_data_smithi070_97781_object40750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.689868+0000", 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0040625890000000001, 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041418440000000004, 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.707 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40751 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689868+0000", 2023-07-29T16:38:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689868+0000", 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689868+0000", 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689936+0000", 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8564000000000003e-05 2023-07-29T16:38:29.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689946+0000", 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.815e-06 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689953+0000", 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7050000000000002e-06 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689974+0000", 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0811000000000001e-05 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690066+0000", 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2695000000000006e-05 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690190+0000", 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012331000000000001 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692626+0000", 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024366449999999999 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.714 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40753 5.2 5:402e3336:::benchmark_data_smithi070_97781_object40752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.689963+0000", 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0039684899999999999, 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040939000000000001, 2023-07-29T16:38:29.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40753 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.716 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689963+0000", 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689963+0000", 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689962+0000", 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.689997+0000", 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4854000000000002e-05 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690005+0000", 2023-07-29T16:38:29.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8760000000000005e-06 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690011+0000", 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0689999999999998e-06 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690046+0000", 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4992e-05 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690172+0000", 2023-07-29T16:38:29.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000126692 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690291+0000", 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118452 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693292+0000", 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003001334 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40754 5.9 5:9721db4c:::benchmark_data_smithi070_97781_object40753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.690020+0000", 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0039107739999999997, 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040823359999999998, 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40754 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690020+0000", 2023-07-29T16:38:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690020+0000", 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690020+0000", 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690052+0000", 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2688999999999998e-05 2023-07-29T16:38:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690060+0000", 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.011e-06 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690068+0000", 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2189999999999998e-06 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.691120+0000", 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0010519850000000001 2023-07-29T16:38:29.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.691234+0000", 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011461200000000001 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:29.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.691364+0000", 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129629 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40755 5.7 5:e3397dad:::benchmark_data_smithi070_97781_object40754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.731 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.690089+0000", 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0038420630000000002, 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040553050000000004, 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40755 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690089+0000", 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690089+0000", 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690088+0000", 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690172+0000", 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3467000000000006e-05 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690190+0000", 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8675999999999999e-05 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690198+0000", 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3150000000000003e-06 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690245+0000", 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7342999999999997e-05 2023-07-29T16:38:29.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690343+0000", 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7911999999999994e-05 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690443+0000", 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000100166 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692362+0000", 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019190279999999999 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.739 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40756 5.2 5:4b0304de:::benchmark_data_smithi070_97781_object40755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.690217+0000", 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0037135340000000001, 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039855389999999997, 2023-07-29T16:38:29.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40756 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690217+0000", 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690217+0000", 2023-07-29T16:38:29.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690217+0000", 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690305+0000", 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7849999999999994e-05 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690315+0000", 2023-07-29T16:38:29.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8870000000000004e-06 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.690333+0000", 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8280000000000001e-05 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.691795+0000", 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001462178 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.691934+0000", 2023-07-29T16:38:29.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013875899999999999 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692052+0000", 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011775800000000001 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.747 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:40758 5.3 e30/19 5:cb79669c:::benchmark_data_smithi070_97781_object40757:head v 30'2600, mlcod=30'2597)", 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.692368+0000", 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0015634690000000001, 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019063540000000001, 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.748 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692368+0000", 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692368+0000", 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692367+0000", 2023-07-29T16:38:29.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692433+0000", 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6147000000000002e-05 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692440+0000", 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9940000000000003e-06 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692445+0000", 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0100000000000003e-06 2023-07-29T16:38:29.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692480+0000", 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4703999999999998e-05 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692498+0000", 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8539e-05 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40760 5.9 5:9633efaa:::benchmark_data_smithi070_97781_object40759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.754 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.692570+0000", 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001361138, 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017750000000000001, 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.755 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40760 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692570+0000", 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692570+0000", 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692569+0000", 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692629+0000", 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9735999999999999e-05 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692642+0000", 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.384e-05 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692649+0000", 2023-07-29T16:38:29.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6989999999999997e-06 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692684+0000", 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5305000000000002e-05 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692866+0000", 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00018210700000000001 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693009+0000", 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014255 2023-07-29T16:38:29.761 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:40761 5.7 5:ee73d303:::benchmark_data_smithi070_97781_object40760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.692681+0000", 2023-07-29T16:38:29.762 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001249846, 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001745428, 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 40761 2023-07-29T16:38:29.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692681+0000", 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692681+0000", 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692681+0000", 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692809+0000", 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012846900000000001 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692822+0000", 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2539e-05 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692828+0000", 2023-07-29T16:38:29.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3840000000000002e-06 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.692886+0000", 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7994000000000001e-05 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693020+0000", 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013439600000000001 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693220+0000", 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019938200000000001 2023-07-29T16:38:29.769 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:40762 5.c e30/19 5:395c96a6:::benchmark_data_smithi070_97781_object40761:head v 30'2618, mlcod=30'2616)", 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.693146+0000", 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00078456100000000003, 2023-07-29T16:38:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001362521, 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693146+0000", 2023-07-29T16:38:29.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693146+0000", 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693146+0000", 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693203+0000", 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7432000000000002e-05 2023-07-29T16:38:29.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693211+0000", 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8970000000000008e-06 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:29.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693217+0000", 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7610000000000004e-06 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693264+0000", 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6751e-05 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:29.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.693328+0000", 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4691999999999997e-05 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:29.777 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:29.777 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 10 2023-07-29T16:38:29.777 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:29.778 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:29.779 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-07-29T16:38:29.779 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:29.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:29.780 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:29.776+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:29.879 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:29.876+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:29.952 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:29.952 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:29.952 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:29.952 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:29.953 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:29.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:30.008 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:30.005+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:30.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 14 16 41683 41667 185.998 152.812 0.00424115 0.00537351 2023-07-29T16:38:30.081 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:30.078+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:30.180 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:30.180 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:30.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:30.180 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:30.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 47.654547104000002, 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.181 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:30.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:30.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:30.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:30.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:30.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229590123000001, 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:30.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:30.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:30.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:30.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:30.204 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229565268000002, 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:30.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:30.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:30.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229533324000002, 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:30.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:30.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:30.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229511713000001, 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:30.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.238 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229487653, 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:30.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:30.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.249 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229452504999998, 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.250 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:30.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:30.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.261 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229416391000001, 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:30.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:30.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:30.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:30.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.272 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229391487999997, 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.273 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:30.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:30.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:30.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:30.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:30.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:30.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:30.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:30.285 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:30.286 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229336515, 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:30.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:30.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:30.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:30.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.298 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229269197999997, 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:30.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:30.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:30.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:30.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:30.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:30.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:30.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:30.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:30.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.311 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229244279, 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:30.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:30.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:30.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229192736000002, 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.323 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:30.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:30.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:30.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.334 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229168788000003, 2023-07-29T16:38:30.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016589201000000001, 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:30.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946869+0000", 2023-07-29T16:38:30.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946880+0000", 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0614e-05 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946885+0000", 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6469999999999997e-06 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948666+0000", 2023-07-29T16:38:30.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001781384 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948670+0000", 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9720000000000003e-06 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954685+0000", 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060152510000000001 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954828+0000", 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014298100000000001 2023-07-29T16:38:30.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955312+0000", 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048344000000000002 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958247+0000", 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029349749999999998 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963305+0000", 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050582989999999996 2023-07-29T16:38:30.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963411+0000", 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106001 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963455+0000", 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4478999999999999e-05 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.346 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229145152000001, 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:30.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:30.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.357 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.229121866, 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:30.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:30.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:30.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:31343 5.2 5:455c8f4e:::benchmark_data_smithi070_97781_object31342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:30.366 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.345277491, 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015779775999999999, 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:30.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:30.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830812+0000", 2023-07-29T16:38:30.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5723000000000002e-05 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830821+0000", 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3019999999999995e-06 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830827+0000", 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7680000000000003e-06 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.833749+0000", 2023-07-29T16:38:30.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029217430000000001 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.833879+0000", 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013022399999999999 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.834019+0000", 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013967299999999999 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.840161+0000", 2023-07-29T16:38:30.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061415360000000004 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846462+0000", 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0063016629999999999 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846503+0000", 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0207999999999999e-05 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846537+0000", 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4613000000000002e-05 2023-07-29T16:38:30.376 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:31744 5.2 5:4cf9e51d:::benchmark_data_smithi070_97781_object31743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:30.377 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.192152375, 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016426498000000001, 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31744 2023-07-29T16:38:30.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:30.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983957+0000", 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5148999999999995e-05 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983969+0000", 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2245e-05 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983976+0000", 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.165e-06 2023-07-29T16:38:30.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992091+0000", 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081144330000000008 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992187+0000", 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6558999999999995e-05 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992313+0000", 2023-07-29T16:38:30.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000125549 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.994705+0000", 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002392145 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000237+0000", 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055317930000000001 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000270+0000", 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2981000000000002e-05 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000309+0000", 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9180000000000001e-05 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.387 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:39411 5.7 5:e1add8f1:::benchmark_data_smithi070_97781_object39410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.0343228680000001, 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015630884000000001, 2023-07-29T16:38:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 39411 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.389 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141711+0000", 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141779+0000", 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8028000000000007e-05 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141789+0000", 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4930000000000004e-06 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141795+0000", 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1059999999999996e-06 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150610+0000", 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0088145810000000002 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150734+0000", 2023-07-29T16:38:30.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012426599999999999 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150862+0000", 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000128388 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.156142+0000", 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052799179999999998 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157255+0000", 2023-07-29T16:38:30.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011133149999999999 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157302+0000", 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6406999999999998e-05 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157343+0000", 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1054999999999999e-05 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:41295 5.f 5:f61aaf39:::benchmark_data_smithi070_97781_object41294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.912630+0000", 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.263404584, 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015585422999999999, 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:30.399 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 41295 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912630+0000", 2023-07-29T16:38:30.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912630+0000", 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912629+0000", 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912711+0000", 2023-07-29T16:38:30.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1227e-05 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912722+0000", 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.153e-05 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.912729+0000", 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0879999999999997e-06 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.916608+0000", 2023-07-29T16:38:30.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038790019999999999 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.916690+0000", 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2083999999999995e-05 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.916772+0000", 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1126999999999998e-05 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.923821+0000", 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070498970000000003 2023-07-29T16:38:30.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.928155+0000", 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043338930000000001 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.928183+0000", 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7566e-05 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.928216+0000", 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2802999999999997e-05 2023-07-29T16:38:30.408 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.409 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.409 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.409 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:30.409 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:30.409 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:30.410 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:30.407+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:30.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:30.511 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:30.508+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:30.596 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:30.596 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42938 5.e e30/19 5:7b44cff4:::benchmark_data_smithi070_97781_object42937:head v 30'2611, mlcod=30'2607)", 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.586932+0000", 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0070570110000000002, 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070760249999999997, 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.597 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.586932+0000", 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.586932+0000", 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.586932+0000", 2023-07-29T16:38:30.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.586986+0000", 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3953000000000003e-05 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.586994+0000", 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0260000000000007e-06 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.587000+0000", 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1670000000000004e-06 2023-07-29T16:38:30.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.587039+0000", 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9257e-05 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.587063+0000", 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4114999999999999e-05 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42940 5.c 5:30e32a72:::benchmark_data_smithi070_97781_object42939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.588608+0000", 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0053817070000000003, 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005449466, 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:30.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42940 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588608+0000", 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588608+0000", 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588607+0000", 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588681+0000", 2023-07-29T16:38:30.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3990000000000001e-05 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588693+0000", 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2778e-05 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588700+0000", 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3820000000000001e-06 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588750+0000", 2023-07-29T16:38:30.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9851000000000001e-05 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588853+0000", 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102935 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588972+0000", 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011987199999999999 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.611 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42941 5.3 5:cfa16f03:::benchmark_data_smithi070_97781_object42940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.588711+0000", 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0052784470000000003, 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054333669999999997, 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:30.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42941 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588711+0000", 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588711+0000", 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588710+0000", 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588809+0000", 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8862000000000003e-05 2023-07-29T16:38:30.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588815+0000", 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9359999999999996e-06 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588821+0000", 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588864+0000", 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3108000000000001e-05 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589001+0000", 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013690100000000001 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589141+0000", 2023-07-29T16:38:30.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139717 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42939 5.2 e30/19 5:4d63350d:::benchmark_data_smithi070_97781_object42938:head v 30'2711, mlcod=30'2709)", 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.588847+0000", 2023-07-29T16:38:30.619 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051424340000000004, 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053702710000000002, 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588847+0000", 2023-07-29T16:38:30.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588847+0000", 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588846+0000", 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588898+0000", 2023-07-29T16:38:30.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1978000000000003e-05 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588907+0000", 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5499999999999995e-06 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588913+0000", 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.601e-06 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588953+0000", 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879000000000002e-05 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.588973+0000", 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9147000000000002e-05 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42942 5.0 e30/19 5:0441d03f:::benchmark_data_smithi070_97781_object42941:head v 30'2719, mlcod=30'2715)", 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.589027+0000", 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049623169999999999, 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052350269999999997, 2023-07-29T16:38:30.626 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589027+0000", 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589027+0000", 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589027+0000", 2023-07-29T16:38:30.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589094+0000", 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7578999999999998e-05 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589101+0000", 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589105+0000", 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7680000000000002e-06 2023-07-29T16:38:30.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589149+0000", 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3510999999999997e-05 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589205+0000", 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6943e-05 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.632 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42944 5.4 e30/19 5:21671da4:::benchmark_data_smithi070_97781_object42943:head v 30'2734, mlcod=30'2732)", 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.589140+0000", 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0048495750000000001, 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051563520000000003, 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589140+0000", 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589140+0000", 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589139+0000", 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589205+0000", 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5556999999999996e-05 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589212+0000", 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1910000000000003e-06 2023-07-29T16:38:30.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589218+0000", 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4940000000000003e-06 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589249+0000", 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.589266+0000", 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6945000000000001e-05 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.638 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42947 5.c 5:33f2ea12:::benchmark_data_smithi070_97781_object42946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.591138+0000", 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028516240000000001, 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032249919999999999, 2023-07-29T16:38:30.639 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42947 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.640 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591138+0000", 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591138+0000", 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591137+0000", 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591248+0000", 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110963 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591258+0000", 2023-07-29T16:38:30.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0257e-05 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591265+0000", 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9979999999999997e-06 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591304+0000", 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8840000000000001e-05 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591422+0000", 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117731 2023-07-29T16:38:30.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591515+0000", 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3059999999999993e-05 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42945 5.7 e30/19 5:e3650989:::benchmark_data_smithi070_97781_object42944:head v 30'2688, mlcod=30'2686)", 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.591382+0000", 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0026072460000000001, 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030520550000000001, 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.647 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591382+0000", 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591382+0000", 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591382+0000", 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591441+0000", 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9821000000000002e-05 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591447+0000", 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9510000000000003e-06 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591453+0000", 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6269999999999997e-06 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591482+0000", 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8640999999999999e-05 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591493+0000", 2023-07-29T16:38:30.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1595e-05 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42950 5.3 5:cea24490:::benchmark_data_smithi070_97781_object42949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.591539+0000", 2023-07-29T16:38:30.653 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024507050000000001, 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029347779999999999, 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42950 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591539+0000", 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591539+0000", 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591538+0000", 2023-07-29T16:38:30.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591662+0000", 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123657 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591673+0000", 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1358999999999999e-05 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591680+0000", 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9920000000000001e-06 2023-07-29T16:38:30.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591733+0000", 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2859000000000003e-05 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591900+0000", 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166937 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592065+0000", 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016571000000000001 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42948 5.2 e30/19 5:443e50ae:::benchmark_data_smithi070_97781_object42947:head v 30'2712, mlcod=30'2709)", 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.591576+0000", 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024132350000000001, 2023-07-29T16:38:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029473210000000001, 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591576+0000", 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591576+0000", 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591576+0000", 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591669+0000", 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3247999999999999e-05 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591677+0000", 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3559999999999993e-06 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591683+0000", 2023-07-29T16:38:30.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0630000000000002e-06 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591720+0000", 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7091000000000001e-05 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591751+0000", 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0666000000000001e-05 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42951 5.8 e30/19 5:196dc8c8:::benchmark_data_smithi070_97781_object42950:head v 30'2687, mlcod=30'2685)", 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.591965+0000", 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002024353, 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025984509999999999, 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591965+0000", 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591965+0000", 2023-07-29T16:38:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.591964+0000", 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592022+0000", 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7982000000000002e-05 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592037+0000", 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4241e-05 2023-07-29T16:38:30.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592043+0000", 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592077+0000", 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3878000000000003e-05 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592099+0000", 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2116999999999998e-05 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.673 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:42952 5.e e30/19 5:7d89be41:::benchmark_data_smithi070_97781_object42951:head v 30'2612, mlcod=30'2608)", 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.592239+0000", 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0017500720000000001, 2023-07-29T16:38:30.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002357544, 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592239+0000", 2023-07-29T16:38:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592239+0000", 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592239+0000", 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592321+0000", 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1823000000000006e-05 2023-07-29T16:38:30.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592331+0000", 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.03e-05 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:30.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592337+0000", 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8069999999999996e-06 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592833+0000", 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049645400000000001 2023-07-29T16:38:30.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.592858+0000", 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.495e-05 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:30.680 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.681 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:30.681 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:30.681 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2023-07-29T16:38:30.681 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:30.682 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:30.679+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:30.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:30.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:30.783 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:30.781+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:30.842 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:30.862 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:30.865 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:30.865 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:30.865 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:30.865 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:30.865 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:30.879 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:30.883 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:30.884 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:30.884 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:30.920 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:30.918+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:30.984 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:30.981+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:31.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 15 16 44102 44086 183.676 151.188 0.00548947 0.00544085 2023-07-29T16:38:31.085 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:31.083+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:31.101 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:31.101 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:31.120 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:31.185 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:31.182+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:31.286 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.284+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:31.296 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:31.296 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:31.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:31.387 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.385+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:31.488 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:31.486+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:31.513 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:31.513 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:31.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:38:31.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:31.589 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.587+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:31.690 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:31.688+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:31.692 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:31.692 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:31.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:31.791 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.788+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:31.879 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:31.879 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:31.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:31.893 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.889+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:31.993 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:31.990+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 16 16 46543 46527 181.73 152.562 0.00902759 0.00549931 2023-07-29T16:38:32.094 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:32.092+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:32.100 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:32.101 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:32.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:32.198 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:32.196+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.295 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:32.292+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:32.324 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:32.324 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:32.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:32.396 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:32.394+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:32.497 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:32.495+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.511 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:38:32.523 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:32.523 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:32.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:32.598 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:32.596+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.699 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:32.697+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:32.760 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:32.761 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:32.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:32.800 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:32.797+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:32.901 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:32.898+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:32.996 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:32.996 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:33.001 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:32.999+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:33.013 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:33.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:33.065 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:33.075 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 17 16 48855 48839 179.54 144.5 0.00443093 0.00556706 2023-07-29T16:38:33.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:33.087 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:33.087 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:33.088 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:33.102 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:33.100+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:33.188 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49116 5.4 5:2c40162e:::benchmark_data_smithi070_97781_object49115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.183456+0000", 2023-07-29T16:38:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0025953679999999998, 2023-07-29T16:38:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026151479999999999, 2023-07-29T16:38:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49116 2023-07-29T16:38:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183456+0000", 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183456+0000", 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183455+0000", 2023-07-29T16:38:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183673+0000", 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021775700000000001 2023-07-29T16:38:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183682+0000", 2023-07-29T16:38:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5099999999999998e-06 2023-07-29T16:38:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183687+0000", 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3009999999999997e-06 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183716+0000", 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9507999999999999e-05 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183800+0000", 2023-07-29T16:38:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4085000000000006e-05 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.183878+0000", 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7051999999999993e-05 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:49114 5.a e31/19 5:5fe08e37:::benchmark_data_smithi070_97781_object49113:head v 31'2985, mlcod=31'2982)", 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.184027+0000", 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0020238119999999998, 2023-07-29T16:38:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002095066, 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184027+0000", 2023-07-29T16:38:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184027+0000", 2023-07-29T16:38:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184027+0000", 2023-07-29T16:38:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184156+0000", 2023-07-29T16:38:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012907199999999999 2023-07-29T16:38:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184165+0000", 2023-07-29T16:38:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9730000000000003e-06 2023-07-29T16:38:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184170+0000", 2023-07-29T16:38:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.853e-06 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184203+0000", 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2716999999999999e-05 2023-07-29T16:38:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184221+0000", 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8267999999999999e-05 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:49117 5.f e31/19 5:fab56522:::benchmark_data_smithi070_97781_object49116:head v 31'3134, mlcod=31'3130)", 2023-07-29T16:38:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.184719+0000", 2023-07-29T16:38:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0013318920000000001, 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001438862, 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184719+0000", 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184719+0000", 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184719+0000", 2023-07-29T16:38:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184770+0000", 2023-07-29T16:38:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1632999999999998e-05 2023-07-29T16:38:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184778+0000", 2023-07-29T16:38:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1640000000000004e-06 2023-07-29T16:38:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184782+0000", 2023-07-29T16:38:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.391e-06 2023-07-29T16:38:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184816+0000", 2023-07-29T16:38:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3970000000000002e-05 2023-07-29T16:38:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184835+0000", 2023-07-29T16:38:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8754999999999999e-05 2023-07-29T16:38:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49118 5.e 5:72207852:::benchmark_data_smithi070_97781_object49117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.184990+0000", 2023-07-29T16:38:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001060713, 2023-07-29T16:38:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012399310000000001, 2023-07-29T16:38:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49118 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184990+0000", 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184990+0000", 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.184990+0000", 2023-07-29T16:38:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185050+0000", 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0646000000000002e-05 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185058+0000", 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6729999999999992e-06 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185063+0000", 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7110000000000003e-06 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185100+0000", 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7347e-05 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185189+0000", 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8605999999999998e-05 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185278+0000", 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9536000000000005e-05 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49119 5.0 5:06b6acb8:::benchmark_data_smithi070_97781_object49118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.185072+0000", 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00097927499999999994, 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001209777, 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49119 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185072+0000", 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185072+0000", 2023-07-29T16:38:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185071+0000", 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185107+0000", 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5243999999999997e-05 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185115+0000", 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4640000000000006e-06 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185120+0000", 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4539999999999998e-06 2023-07-29T16:38:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185158+0000", 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7156000000000001e-05 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185269+0000", 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011186199999999999 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185393+0000", 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012307 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:49120 5.9 e31/19 5:9c1a99de:::benchmark_data_smithi070_97781_object49119:head v 31'3085, mlcod=31'3082)", 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.185584+0000", 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00046764199999999999, 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076442999999999997, 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185584+0000", 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185584+0000", 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185583+0000", 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185637+0000", 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3548999999999998e-05 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185649+0000", 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2279999999999999e-05 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185655+0000", 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3090000000000001e-06 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185685+0000", 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9873e-05 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185697+0000", 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.242e-05 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49122 5.4 5:23a48487:::benchmark_data_smithi070_97781_object49121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.185751+0000", 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000300384, 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065908199999999996, 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49122 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185751+0000", 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185751+0000", 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185750+0000", 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185813+0000", 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3246999999999999e-05 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185824+0000", 2023-07-29T16:38:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0190999999999999e-05 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185830+0000", 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.156e-06 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185868+0000", 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8702000000000003e-05 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.185998+0000", 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012926699999999999 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.186128+0000", 2023-07-29T16:38:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013005300000000001 2023-07-29T16:38:33.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.257 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.258 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:33.258 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:38:33.258 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:33.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:33.262 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:33.257+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:33.361 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:33.359+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:33.462 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:33.459+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:33.465 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:33.465 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:33.466 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:33.466 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:33.466 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:33.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:33.563 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:33.561+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:33.664 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:33.662+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:33.691 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:33.691 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:33.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:33.692 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:33.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.692 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.692 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:33.692 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.739233132999999, 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:33.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:33.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:33.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:33.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:33.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738932148000004, 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:33.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:33.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:33.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:33.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:33.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:33.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738899394000001, 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:33.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:33.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:33.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:33.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:33.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:33.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:33.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738868513, 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:33.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:33.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:33.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:33.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:33.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:33.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:33.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:33.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:33.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:33.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:33.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:33.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:33.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:33.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:33.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:33.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:33.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738847143000001, 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:33.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:33.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:33.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:33.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:33.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:33.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:33.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:33.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:33.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:33.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:33.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:33.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.762 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.762 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:33.762 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738812697, 2023-07-29T16:38:33.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:33.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.763 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:33.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:33.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:33.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738791020000001, 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:33.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:33.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:33.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.738312641999997, 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:33.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:33.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1712253609999994, 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27884 5.e 5:7df06602:::benchmark_data_smithi070_97781_object27883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1709041649999996, 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015390623000000001, 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27884 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515639+0000", 2023-07-29T16:38:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515693+0000", 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515702+0000", 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8009999999999998e-06 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515708+0000", 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6500000000000001e-06 2023-07-29T16:38:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516811+0000", 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011030370000000001 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516934+0000", 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517091+0000", 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015713000000000001 2023-07-29T16:38:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520518+0000", 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034265049999999998 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530982+0000", 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010464141 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531011+0000", 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-05 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531030+0000", 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9394000000000001e-05 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27886 5.e 5:7783bbaa:::benchmark_data_smithi070_97781_object27885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1706619049999993, 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015423605999999999, 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27886 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515881+0000", 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515909+0000", 2023-07-29T16:38:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8283999999999999e-05 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515915+0000", 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515919+0000", 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9060000000000004e-06 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517921+0000", 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002002078 2023-07-29T16:38:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518055+0000", 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013362000000000001 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518215+0000", 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015999800000000001 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520523+0000", 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023083040000000002 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531225+0000", 2023-07-29T16:38:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701657 2023-07-29T16:38:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531269+0000", 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4561999999999998e-05 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531305+0000", 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6035000000000003e-05 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8847549380000004, 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39119 5.b 5:d24c1e56:::benchmark_data_smithi070_97781_object39118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6579524809999997, 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015792800999999999, 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39119 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028631+0000", 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0861000000000001e-05 2023-07-29T16:38:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028657+0000", 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5624999999999999e-05 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028671+0000", 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030170+0000", 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014990820000000001 2023-07-29T16:38:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030302+0000", 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013176900000000001 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030437+0000", 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013460600000000001 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032638+0000", 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022014700000000001 2023-07-29T16:38:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044293+0000", 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011655341 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044343+0000", 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0065000000000003e-05 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044384+0000", 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0528999999999998e-05 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39120 5.d 5:bc2291c6:::benchmark_data_smithi070_97781_object39119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6578633289999996, 2023-07-29T16:38:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015266223000000001, 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39120 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028712+0000", 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2678000000000001e-05 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028727+0000", 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4817999999999999e-05 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028734+0000", 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0729999999999999e-06 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028770+0000", 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5618999999999999e-05 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028861+0000", 2023-07-29T16:38:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0867999999999998e-05 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028969+0000", 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108378 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032016+0000", 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030467229999999999 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043860+0000", 2023-07-29T16:38:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011843806 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043905+0000", 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5565999999999997e-05 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043947+0000", 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1304000000000003e-05 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39121 5.d 5:bce715e6:::benchmark_data_smithi070_97781_object39120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6576345349999997, 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015107417, 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39121 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028908+0000", 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028961+0000", 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2781999999999997e-05 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028973+0000", 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1783000000000001e-05 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028981+0000", 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4249999999999998e-06 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030155+0000", 2023-07-29T16:38:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011737589999999999 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030301+0000", 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014600099999999999 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030466+0000", 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016504200000000001 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032852+0000", 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002385599 2023-07-29T16:38:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043957+0000", 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011105001999999999 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043995+0000", 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7954999999999998e-05 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044017+0000", 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2022999999999999e-05 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:42619 5.4 5:2d7448ad:::benchmark_data_smithi070_97781_object42618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:30.454015+0000", 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.2325287290000002, 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014691176, 2023-07-29T16:38:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 42619 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454015+0000", 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454015+0000", 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454014+0000", 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454086+0000", 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1981000000000001e-05 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454096+0000", 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2439999999999999e-06 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454103+0000", 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3119999999999996e-06 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454137+0000", 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3821e-05 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454219+0000", 2023-07-29T16:38:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2466999999999995e-05 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.454306+0000", 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6868999999999998e-05 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.456590+0000", 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002283658 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.468649+0000", 2023-07-29T16:38:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012059148 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.468676+0000", 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6818999999999999e-05 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:30.468706+0000", 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0408000000000001e-05 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49550 5.4 5:276572ad:::benchmark_data_smithi070_97781_object49549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.372882+0000", 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.313662155, 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014683366, 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49550 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372882+0000", 2023-07-29T16:38:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372882+0000", 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372881+0000", 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372942+0000", 2023-07-29T16:38:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0954e-05 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372952+0000", 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9250000000000007e-06 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372959+0000", 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2350000000000002e-06 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.376636+0000", 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036776809999999999 2023-07-29T16:38:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.376794+0000", 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158078 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.376936+0000", 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141166 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.380581+0000", 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00364518 2023-07-29T16:38:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387500+0000", 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069193789999999998 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387530+0000", 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0105999999999999e-05 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387565+0000", 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4567000000000003e-05 2023-07-29T16:38:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:49551 5.4 5:20d1d96c:::benchmark_data_smithi070_97781_object49550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.372966+0000", 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.31357766500000001, 2023-07-29T16:38:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014713117, 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49551 2023-07-29T16:38:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372966+0000", 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372966+0000", 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372965+0000", 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.372995+0000", 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9788999999999999e-05 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.373003+0000", 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6299999999999998e-06 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.373009+0000", 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1410000000000002e-06 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.378533+0000", 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055241589999999998 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.378693+0000", 2023-07-29T16:38:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015956999999999999 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.378847+0000", 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015383899999999999 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.382396+0000", 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035488859999999998 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387607+0000", 2023-07-29T16:38:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052111919999999999 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387646+0000", 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9524000000000003e-05 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.387679+0000", 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2906e-05 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.898 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:50013 5.e 5:73c97b01:::benchmark_data_smithi070_97781_object50012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.11547257, 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015001417, 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.899 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50013 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571119+0000", 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7979999999999998e-05 2023-07-29T16:38:33.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571126+0000", 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7600000000000002e-06 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571139+0000", 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3022e-05 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574203+0000", 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003063844 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574295+0000", 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000004e-05 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574434+0000", 2023-07-29T16:38:33.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013895499999999999 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.578093+0000", 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036591520000000002 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.585978+0000", 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078848640000000001 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.586030+0000", 2023-07-29T16:38:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1511000000000002e-05 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.586073+0000", 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2991999999999998e-05 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:50029 5.8 5:1e005dba:::benchmark_data_smithi070_97781_object50028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.105566755, 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01523326, 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:33.909 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50029 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:33.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580976+0000", 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:33.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581063+0000", 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7100000000000003e-05 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581073+0000", 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3479999999999993e-06 2023-07-29T16:38:33.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581078+0000", 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2909999999999998e-06 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:33.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581107+0000", 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9017999999999999e-05 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581204+0000", 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6792000000000004e-05 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581288+0000", 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3869000000000006e-05 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.582956+0000", 2023-07-29T16:38:33.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001668051 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596121+0000", 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013165745 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596172+0000", 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0355000000000002e-05 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596210+0000", 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8513999999999998e-05 2023-07-29T16:38:33.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.919 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:33.919 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:33.919 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:33.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:33.921 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:33.917+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:34.021 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:34.018+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:34.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 18 16 51177 51161 177.627 145.125 0.00540302 0.00562715 2023-07-29T16:38:34.091 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:34.091 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:51206 5.d e31/19 5:b84a255b:::benchmark_data_smithi070_97781_object51205:head v 31'3180, mlcod=31'3178)", 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:34.086290+0000", 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0033196229999999998, 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033370420000000001, 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086290+0000", 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086290+0000", 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086289+0000", 2023-07-29T16:38:34.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086359+0000", 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0041000000000002e-05 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086372+0000", 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2587e-05 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086378+0000", 2023-07-29T16:38:34.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5309999999999998e-06 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086402+0000", 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4051000000000001e-05 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.086414+0000", 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1494999999999999e-05 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.098 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:51207 5.1 5:806a8dab:::benchmark_data_smithi070_97781_object51206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:34.087445+0000", 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0021646130000000001, 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002224831, 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 51207 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087445+0000", 2023-07-29T16:38:34.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087445+0000", 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087444+0000", 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087494+0000", 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0127000000000003e-05 2023-07-29T16:38:34.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087508+0000", 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4113e-05 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087514+0000", 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5110000000000003e-06 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087542+0000", 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8515999999999999e-05 2023-07-29T16:38:34.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087630+0000", 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8276999999999995e-05 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.087709+0000", 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8808999999999997e-05 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:51208 5.3 e31/19 5:c77e8eb8:::benchmark_data_smithi070_97781_object51207:head v 31'3211, mlcod=31'3208)", 2023-07-29T16:38:34.106 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:34.088462+0000", 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001147644, 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001251166, 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088462+0000", 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088462+0000", 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088461+0000", 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088521+0000", 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9367000000000003e-05 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088528+0000", 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8739999999999997e-06 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088531+0000", 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.659e-06 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088560+0000", 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9008000000000001e-05 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088573+0000", 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2335e-05 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.112 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:51212 5.9 5:9430ec78:::benchmark_data_smithi070_97781_object51211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:34.088787+0000", 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00082200899999999996, 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000960976, 2023-07-29T16:38:34.113 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 51212 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088787+0000", 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088787+0000", 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088786+0000", 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088909+0000", 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012270799999999999 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088922+0000", 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2592000000000001e-05 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088928+0000", 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5740000000000001e-06 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088953+0000", 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4824000000000002e-05 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.089060+0000", 2023-07-29T16:38:34.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107323 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.089184+0000", 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012357899999999999 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.120 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:51210 5.6 e31/19 5:67daba52:::benchmark_data_smithi070_97781_object51209:head v 31'3075, mlcod=31'3073)", 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:34.088801+0000", 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00080864499999999998, 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00098854999999999993, 2023-07-29T16:38:34.121 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088801+0000", 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088801+0000", 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088800+0000", 2023-07-29T16:38:34.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088952+0000", 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000151824 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088959+0000", 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3570000000000003e-06 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088965+0000", 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1940000000000003e-06 2023-07-29T16:38:34.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.088999+0000", 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3828000000000002e-05 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:34.089019+0000", 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9967e-05 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 5 2023-07-29T16:38:34.127 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:34.129 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:34.126+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:34.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:34.230 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:34.227+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:34.331 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:34.329+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:34.340 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:34.341 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:34.341 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:34.341 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:34.341 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:34.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:34.432 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:34.430+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:34.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:38:34.532 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:34.530+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:34.534 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:34.535 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:34.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:34.535 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:34.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.535 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:34.536 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:34.536 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 52.008967824999999, 2023-07-29T16:38:34.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:34.536 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.536 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:34.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:34.538 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:34.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.538 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:34.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:34.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:34.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:34.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:34.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:34.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:34.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:34.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:34.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.550 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.584010843999998, 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:34.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:34.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:34.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583985988999999, 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.563 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.564 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:34.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:34.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:34.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:34.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.575 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583954044999999, 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:34.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:34.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583932433999998, 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.587 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:34.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:34.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:34.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:34.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:34.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.599 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583908374000004, 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:34.600 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:34.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:34.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:34.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.611 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583873226000001, 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:34.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:34.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:34.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:34.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:34.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:34.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:34.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.624 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:34.625 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583837111999998, 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:34.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:34.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:34.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:34.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:34.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.636 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583812209000001, 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:34.637 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:34.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:34.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:34.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:34.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:34.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:34.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.650 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.650 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:34.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583757235999997, 2023-07-29T16:38:34.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:34.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:34.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:34.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:34.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:34.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:34.662 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583689919000001, 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:34.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:34.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:34.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:34.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:34.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:34.673 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:34.674 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583665000000003, 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:34.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:34.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:34.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583613456999998, 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.687 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:34.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:34.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:34.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.697 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583589508999999, 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016589201000000001, 2023-07-29T16:38:34.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946866+0000", 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946869+0000", 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946880+0000", 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0614e-05 2023-07-29T16:38:34.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946885+0000", 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6469999999999997e-06 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948666+0000", 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001781384 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.948670+0000", 2023-07-29T16:38:34.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9720000000000003e-06 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954685+0000", 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060152510000000001 2023-07-29T16:38:34.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954828+0000", 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014298100000000001 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955312+0000", 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048344000000000002 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958247+0000", 2023-07-29T16:38:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029349749999999998 2023-07-29T16:38:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963305+0000", 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050582989999999996 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963411+0000", 2023-07-29T16:38:34.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106001 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963455+0000", 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4478999999999999e-05 2023-07-29T16:38:34.710 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583565872999998, 2023-07-29T16:38:34.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:34.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:34.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:34.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:34.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:34.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.722 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.583542586999997, 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:34.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:34.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:34.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:34.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:31343 5.2 5:455c8f4e:::benchmark_data_smithi070_97781_object31342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.6996982119999995, 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015779775999999999, 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.734 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31343 2023-07-29T16:38:34.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830757+0000", 2023-07-29T16:38:34.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830812+0000", 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5723000000000002e-05 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830821+0000", 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3019999999999995e-06 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.830827+0000", 2023-07-29T16:38:34.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7680000000000003e-06 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.833749+0000", 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029217430000000001 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.833879+0000", 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013022399999999999 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.834019+0000", 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013967299999999999 2023-07-29T16:38:34.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.840161+0000", 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061415360000000004 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846462+0000", 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0063016629999999999 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846503+0000", 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0207999999999999e-05 2023-07-29T16:38:34.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.846537+0000", 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4613000000000002e-05 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.743 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:31744 5.2 5:4cf9e51d:::benchmark_data_smithi070_97781_object31743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.5465730959999995, 2023-07-29T16:38:34.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016426498000000001, 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 31744 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983882+0000", 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983957+0000", 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5148999999999995e-05 2023-07-29T16:38:34.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983969+0000", 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2245e-05 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.983976+0000", 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.165e-06 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992091+0000", 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081144330000000008 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992187+0000", 2023-07-29T16:38:34.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6558999999999995e-05 2023-07-29T16:38:34.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.992313+0000", 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000125549 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:25.994705+0000", 2023-07-29T16:38:34.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002392145 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000237+0000", 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055317930000000001 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000270+0000", 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2981000000000002e-05 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:26.000309+0000", 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9180000000000001e-05 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:39411 5.7 5:e1add8f1:::benchmark_data_smithi070_97781_object39410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:34.755 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.3887435889999997, 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015630884000000001, 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.756 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 39411 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141712+0000", 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141711+0000", 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141779+0000", 2023-07-29T16:38:34.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8028000000000007e-05 2023-07-29T16:38:34.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141789+0000", 2023-07-29T16:38:34.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4930000000000004e-06 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.141795+0000", 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1059999999999996e-06 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150610+0000", 2023-07-29T16:38:34.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0088145810000000002 2023-07-29T16:38:34.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150734+0000", 2023-07-29T16:38:34.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012426599999999999 2023-07-29T16:38:34.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.150862+0000", 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000128388 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.156142+0000", 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052799179999999998 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157255+0000", 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011133149999999999 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157302+0000", 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6406999999999998e-05 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:29.157343+0000", 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1054999999999999e-05 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:50927 5.1 5:82d3a54d:::benchmark_data_smithi070_97781_object50926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:33.965958+0000", 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.56449807100000005, 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015737956000000001, 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:34.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 50927 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.965958+0000", 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.965958+0000", 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:34.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.965957+0000", 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:34.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966088+0000", 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013080700000000001 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966095+0000", 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3849999999999996e-06 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966101+0000", 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3859999999999998e-06 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:34.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966134+0000", 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3685e-05 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966254+0000", 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011945199999999999 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.966378+0000", 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000124101 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.969138+0000", 2023-07-29T16:38:34.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027605899999999998 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.981602+0000", 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012463783000000001 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.981652+0000", 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9669000000000002e-05 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:34.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:33.981695+0000", 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3625000000000003e-05 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:34.778 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:34.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:34.781 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:34.777+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:34.781 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:34.781 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:34.782 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T16:38:34.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:38:34.880 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:34.878+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:34.970 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53222 5.6 5:64863ffa:::benchmark_data_smithi070_97781_object53221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:34.966427+0000", 2023-07-29T16:38:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001501142, 2023-07-29T16:38:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001523595, 2023-07-29T16:38:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53222 2023-07-29T16:38:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966427+0000", 2023-07-29T16:38:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966427+0000", 2023-07-29T16:38:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966426+0000", 2023-07-29T16:38:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966540+0000", 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113415 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966547+0000", 2023-07-29T16:38:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9099999999999999e-06 2023-07-29T16:38:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966551+0000", 2023-07-29T16:38:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6689999999999997e-06 2023-07-29T16:38:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966584+0000", 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2972999999999998e-05 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966689+0000", 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010503800000000001 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.966807+0000", 2023-07-29T16:38:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117176 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53203 5.5 5:a299dc4a:::benchmark_data_smithi070_97781_object53202:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:34.957454+0000", 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010474812999999999, 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010555624, 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53203 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957454+0000", 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957454+0000", 2023-07-29T16:38:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957452+0000", 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957551+0000", 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8097999999999995e-05 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957564+0000", 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3305999999999999e-05 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.957573+0000", 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3500000000000003e-06 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958176+0000", 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060315900000000003 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958307+0000", 2023-07-29T16:38:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130493 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958431+0000", 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012447200000000001 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.961515+0000", 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003083887 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53206 5.5 5:aeca2220:::benchmark_data_smithi070_97781_object53205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:34.958327+0000", 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0096018030000000008, 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097321040000000001, 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53206 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958327+0000", 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958327+0000", 2023-07-29T16:38:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958326+0000", 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958432+0000", 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106572 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958444+0000", 2023-07-29T16:38:34.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1406999999999999e-05 2023-07-29T16:38:34.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:34.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:34.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:34.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958452+0000", 2023-07-29T16:38:34.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0620000000000001e-06 2023-07-29T16:38:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.959893+0000", 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001440895 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960015+0000", 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012285799999999999 2023-07-29T16:38:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960142+0000", 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012670499999999999 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.962652+0000", 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025095780000000002 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53207 5.6 5:6a0a089a:::benchmark_data_smithi070_97781_object53206:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:34.958638+0000", 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0092900229999999997, 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094710720000000005, 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53207 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958638+0000", 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958638+0000", 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958626+0000", 2023-07-29T16:38:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999876 2023-07-29T16:38:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958752+0000", 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126215 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958766+0000", 2023-07-29T16:38:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3644e-05 2023-07-29T16:38:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958774+0000", 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6709999999999999e-06 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958813+0000", 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9798000000000001e-05 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958901+0000", 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7163999999999994e-05 2023-07-29T16:38:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.958994+0000", 2023-07-29T16:38:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3626000000000001e-05 2023-07-29T16:38:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.962902+0000", 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003908094 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53213 5.6 5:6321f4c4:::benchmark_data_smithi070_97781_object53212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:34.960639+0000", 2023-07-29T16:38:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0072888629999999996, 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075248279999999999, 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53213 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960639+0000", 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960639+0000", 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960639+0000", 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960698+0000", 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9295000000000001e-05 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960712+0000", 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4249e-05 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960722+0000", 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8519999999999999e-06 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960766+0000", 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3857999999999999e-05 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.960953+0000", 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018678600000000001 2023-07-29T16:38:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.961117+0000", 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016475800000000001 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:34.964417+0000", 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032994299999999999 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:35.024 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 5 2023-07-29T16:38:35.024 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:35.025 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.022+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:35.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:35.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 19 16 53458 53442 175.781 142.562 0.00694144 0.00568596 2023-07-29T16:38:35.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:35.126 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.123+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:35.127 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:35.127 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 31, 2023-07-29T16:38:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:38:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:38:32.504501+0000", 2023-07-29T16:38:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:37:40.281964+0000", 2023-07-29T16:38:35.128 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:38:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:38:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2023-07-29T16:38:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:38:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2023-07-29T16:38:35.129 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:38:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:38:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:38:35.130 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:38:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:38:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 5, 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:38:35.132 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.133 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:35.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:35.135 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:38:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.137 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:35.138 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:35.139 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:35.140 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:35.141 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:35.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:35.143 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:38:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:38:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:35.145 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:38:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:35.146 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:38:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:38:35.147 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:38:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:38:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:38:35.148 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:35.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:38:35.150 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:38:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:38:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:35.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:35.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:35.153 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:35.155 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:35.156 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:35.157 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:35.158 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:35.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:35.160 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:35.161 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:35.162 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:35.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:35.165 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:35.166 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:35.167 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:35.168 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:35.169 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:35.170 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:38:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:38:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2023-07-29T16:38:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "unique_pool_0", 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:38:13.069639+0000", 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 16, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 16, 2023-07-29T16:38:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 16, 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 16, 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 16, 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:35.191 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:35.192 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:35.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:35.194 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:35.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:35.196 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "rados": {} 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.197 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:35.198 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:35.199 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:35.200 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 27, 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.201 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.203 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:38:35.204 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:38:35.206 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.207 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:35.207 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:35.210 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:35.211 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:35.212 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:38:35.213 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.216 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.219 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:38:35.220 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.221 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:35.222 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.223 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:38:35.225 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:38:35.227 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:38:35.229 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:35.231 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:38:35.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:38:35.233 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:35.234 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:35.235 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:35.236 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.c", 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: 0, 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2023-07-29T16:38:35.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:38:35.238 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:38:35.239 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:38:35.240 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:38:35.240 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:38:35.240 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:38:35.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:38:35.241 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:38:35.242 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:38:35.242 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:38:35.242 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:38:35.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:35.242 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:35.243 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:35.241+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:35.244 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:35.245 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:35.245 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:38:32.504501+0000', 'last_up_change': '2023-07-29T16:37:40.281964+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-07-29T16:38:13.069639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.c', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:38:35.246 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.c 2023-07-29T16:38:35.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.c 2023-07-29T16:38:35.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:35.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:35.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:35.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:35.296 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:35.344 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:35.342+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:35.427 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:35.442 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:35.445 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:35.442+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:38:35.546 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.543+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:35.610 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:35.611 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:35.624 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:35.665 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.662+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:35.748 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.745+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:35.828 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:35.829 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:35.843 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:35.848 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:35.846+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:35.950 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:35.947+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:36.051 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:36.049+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:36.053 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:36.053 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:36.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:36.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:2023-07-29T16:38:36.074817+0000 min lat: 0.00112574 max lat: 0.0721942 avg lat: 0.00574521 2023-07-29T16:38:36.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-07-29T16:38:36.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 20 16 55692 55676 173.973 139.625 0.00794627 0.00574521 2023-07-29T16:38:36.151 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:36.148+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:36.237 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:36.237 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:36.253 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:36.254 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:36.250+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:36.354 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:36.352+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:36.455 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:36.453+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:36.462 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:36.462 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:36.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:36.521 INFO:teuthology.orchestra.run.smithi070.stderr:clear 3.c pg_upmap mapping 2023-07-29T16:38:36.556 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:36.553+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:36.650 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:36.651 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:36.657 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:36.654+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:36.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:36.758 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:36.755+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:36.852 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:36.853 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:36.859 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:36.857+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:36.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:36.960 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:36.958+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:37.053 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:37.053 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:37.061 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:37.059+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:37.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:37.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 21 16 57862 57846 172.146 135.625 0.00899086 0.00580579 2023-07-29T16:38:37.161 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:37.159+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:37.262 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:37.259+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:37.295 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:37.295 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:37.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:37.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:37.363 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:37.360+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:37.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:37.464 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:37.462+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:37.479 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:37.482 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:58737 5.b 5:d605d3b0:::benchmark_data_smithi070_97781_object58736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-07-29T16:38:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.480656+0000", 2023-07-29T16:38:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00037743299999999999, 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039892299999999998, 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58737 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480656+0000", 2023-07-29T16:38:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480656+0000", 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480655+0000", 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480701+0000", 2023-07-29T16:38:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5671999999999999e-05 2023-07-29T16:38:37.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480709+0000", 2023-07-29T16:38:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5399999999999996e-06 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480714+0000", 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8790000000000002e-06 2023-07-29T16:38:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480744+0000", 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9648000000000001e-05 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480836+0000", 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2645000000000005e-05 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480923+0000", 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6712999999999995e-05 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:58727 5.0 5:0707f61f:::benchmark_data_smithi070_97781_object58726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.474670+0000", 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0063631240000000004, 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006437122, 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:37.495 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58727 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474670+0000", 2023-07-29T16:38:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474670+0000", 2023-07-29T16:38:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474669+0000", 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474758+0000", 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9022000000000002e-05 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474766+0000", 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7570000000000004e-06 2023-07-29T16:38:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.474772+0000", 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3890000000000002e-06 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475637+0000", 2023-07-29T16:38:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086493400000000004 2023-07-29T16:38:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475754+0000", 2023-07-29T16:38:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011709099999999999 2023-07-29T16:38:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475890+0000", 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013585800000000001 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.477910+0000", 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002019439 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:58729 5.4 5:2a2b096e:::benchmark_data_smithi070_97781_object58728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.475135+0000", 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0058982779999999999, 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060336440000000003, 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58729 2023-07-29T16:38:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475135+0000", 2023-07-29T16:38:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475135+0000", 2023-07-29T16:38:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475134+0000", 2023-07-29T16:38:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475200+0000", 2023-07-29T16:38:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6410999999999998e-05 2023-07-29T16:38:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475212+0000", 2023-07-29T16:38:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593000000000001e-05 2023-07-29T16:38:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475221+0000", 2023-07-29T16:38:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0920000000000004e-06 2023-07-29T16:38:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475257+0000", 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6106999999999998e-05 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475377+0000", 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001197 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.475518+0000", 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014086900000000001 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.477510+0000", 2023-07-29T16:38:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019921069999999999 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:58731 5.8 5:15cea5cd:::benchmark_data_smithi070_97781_object58730:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2023-07-29T16:38:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.478125+0000", 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029077740000000001, 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030938900000000002, 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58731 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478125+0000", 2023-07-29T16:38:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478125+0000", 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478125+0000", 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478184+0000", 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9531000000000003e-05 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478193+0000", 2023-07-29T16:38:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4630000000000001e-06 2023-07-29T16:38:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478199+0000", 2023-07-29T16:38:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0920000000000003e-06 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478225+0000", 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6557e-05 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478312+0000", 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6706999999999995e-05 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.478397+0000", 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5353999999999996e-05 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.480181+0000", 2023-07-29T16:38:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001783827 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 4 2023-07-29T16:38:37.528 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:37.529 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:37.530 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:37.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:37.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:37.532 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:37.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:38:37.571 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:37.568+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:37.666 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:37.663+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:37.734 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:37.735 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:37.735 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:37.735 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:37.735 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:37.748 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:37.767 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:37.764+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:37.868 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:37.865+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:37.918 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:37.918 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:37.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:37.919 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:37.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.919 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.920 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:37.920 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966631667999998, 2023-07-29T16:38:37.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:37.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.921 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:37.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:37.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:37.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:37.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:37.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:37.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:37.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:37.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:37.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966330683000002, 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:37.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:37.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:37.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:37.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:37.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966297929, 2023-07-29T16:38:37.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:37.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:37.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:37.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:37.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:37.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966267047999999, 2023-07-29T16:38:37.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:37.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:37.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:37.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:37.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:37.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.969 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966245678, 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:37.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.980 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966211231999999, 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:37.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:37.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:37.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:37.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.966189555, 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:37.992 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:37.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:37.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:37.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:37.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:38.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.965711177000003, 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:38.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:38.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:38.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:38.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:38.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:38.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:38.012 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.398623896, 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.013 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:38.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:38.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:38.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:38.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.022 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27884 5.e 5:7df06602:::benchmark_data_smithi070_97781_object27883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.3983027, 2023-07-29T16:38:38.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015390623000000001, 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27884 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.024 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515639+0000", 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515693+0000", 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515702+0000", 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8009999999999998e-06 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515708+0000", 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6500000000000001e-06 2023-07-29T16:38:38.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516811+0000", 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011030370000000001 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516934+0000", 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517091+0000", 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015713000000000001 2023-07-29T16:38:38.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520518+0000", 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034265049999999998 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530982+0000", 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010464141 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531011+0000", 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-05 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531030+0000", 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9394000000000001e-05 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27886 5.e 5:7783bbaa:::benchmark_data_smithi070_97781_object27885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.39806044, 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015423605999999999, 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.034 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27886 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515881+0000", 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515909+0000", 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8283999999999999e-05 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515915+0000", 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2023-07-29T16:38:38.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515919+0000", 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9060000000000004e-06 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517921+0000", 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002002078 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518055+0000", 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013362000000000001 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518215+0000", 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015999800000000001 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520523+0000", 2023-07-29T16:38:38.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023083040000000002 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531225+0000", 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701657 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531269+0000", 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4561999999999998e-05 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531305+0000", 2023-07-29T16:38:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6035000000000003e-05 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:38.044 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.112153472999999, 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.045 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:38.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:38.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39119 5.b 5:d24c1e56:::benchmark_data_smithi070_97781_object39118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8853510159999995, 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015792800999999999, 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39119 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028631+0000", 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0861000000000001e-05 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028657+0000", 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5624999999999999e-05 2023-07-29T16:38:38.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028671+0000", 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030170+0000", 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014990820000000001 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030302+0000", 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013176900000000001 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030437+0000", 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013460600000000001 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032638+0000", 2023-07-29T16:38:38.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022014700000000001 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044293+0000", 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011655341 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044343+0000", 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0065000000000003e-05 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044384+0000", 2023-07-29T16:38:38.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0528999999999998e-05 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39120 5.d 5:bc2291c6:::benchmark_data_smithi070_97781_object39119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:38.065 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8852618640000003, 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015266223000000001, 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39120 2023-07-29T16:38:38.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028680+0000", 2023-07-29T16:38:38.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028712+0000", 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2678000000000001e-05 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028727+0000", 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4817999999999999e-05 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028734+0000", 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0729999999999999e-06 2023-07-29T16:38:38.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028770+0000", 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5618999999999999e-05 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028861+0000", 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0867999999999998e-05 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028969+0000", 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108378 2023-07-29T16:38:38.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032016+0000", 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030467229999999999 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043860+0000", 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011843806 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043905+0000", 2023-07-29T16:38:38.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5565999999999997e-05 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043947+0000", 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1304000000000003e-05 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.075 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39121 5.d 5:bce715e6:::benchmark_data_smithi070_97781_object39120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8850330700000004, 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015107417, 2023-07-29T16:38:38.076 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39121 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028909+0000", 2023-07-29T16:38:38.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028908+0000", 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028961+0000", 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2781999999999997e-05 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028973+0000", 2023-07-29T16:38:38.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1783000000000001e-05 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028981+0000", 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4249999999999998e-06 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030155+0000", 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011737589999999999 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030301+0000", 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014600099999999999 2023-07-29T16:38:38.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030466+0000", 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016504200000000001 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032852+0000", 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002385599 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043957+0000", 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011105001999999999 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.043995+0000", 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7954999999999998e-05 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044017+0000", 2023-07-29T16:38:38.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2022999999999999e-05 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:50013 5.e 5:73c97b01:::benchmark_data_smithi070_97781_object50012:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:38.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3428711050000004, 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015001417, 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50013 2023-07-29T16:38:38.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:38.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:38.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571071+0000", 2023-07-29T16:38:38.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571119+0000", 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7979999999999998e-05 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571126+0000", 2023-07-29T16:38:38.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7600000000000002e-06 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.571139+0000", 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3022e-05 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574203+0000", 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003063844 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574295+0000", 2023-07-29T16:38:38.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000004e-05 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.574434+0000", 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013895499999999999 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.578093+0000", 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036591520000000002 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.585978+0000", 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078848640000000001 2023-07-29T16:38:38.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.586030+0000", 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1511000000000002e-05 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.586073+0000", 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2991999999999998e-05 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:50029 5.8 5:1e005dba:::benchmark_data_smithi070_97781_object50028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3329652899999997, 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01523326, 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50029 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580977+0000", 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.580976+0000", 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581063+0000", 2023-07-29T16:38:38.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7100000000000003e-05 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581073+0000", 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3479999999999993e-06 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581078+0000", 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2909999999999998e-06 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581107+0000", 2023-07-29T16:38:38.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9017999999999999e-05 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581204+0000", 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6792000000000004e-05 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.581288+0000", 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3869000000000006e-05 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.582956+0000", 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001668051 2023-07-29T16:38:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596121+0000", 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013165745 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596172+0000", 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0355000000000002e-05 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:33.596210+0000", 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8513999999999998e-05 2023-07-29T16:38:38.108 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:59199 5.b 5:d1b3f441:::benchmark_data_smithi070_97781_object59198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.687590+0000", 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.226352515, 2023-07-29T16:38:38.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015286562, 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 59199 2023-07-29T16:38:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687590+0000", 2023-07-29T16:38:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687590+0000", 2023-07-29T16:38:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687589+0000", 2023-07-29T16:38:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687677+0000", 2023-07-29T16:38:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7868000000000006e-05 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687685+0000", 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7610000000000007e-06 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.687692+0000", 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.52e-06 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.689714+0000", 2023-07-29T16:38:38.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020218419999999998 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.689841+0000", 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012678400000000001 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.689975+0000", 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013385900000000001 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.693033+0000", 2023-07-29T16:38:38.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030580910000000002 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.702763+0000", 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097302819999999998 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.702824+0000", 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0630000000000001e-05 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.702876+0000", 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2586000000000001e-05 2023-07-29T16:38:38.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:59315 5.4 5:26dd69f8:::benchmark_data_smithi070_97781_object59314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.17028284099999999, 2023-07-29T16:38:38.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016419021999999998, 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 59315 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.122 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743688+0000", 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9192000000000001e-05 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743695+0000", 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1770000000000001e-06 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743702+0000", 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1760000000000004e-06 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750657+0000", 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069546260000000002 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750749+0000", 2023-07-29T16:38:38.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2001000000000002e-05 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750839+0000", 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0304999999999997e-05 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.754808+0000", 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039689149999999999 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.759982+0000", 2023-07-29T16:38:38.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051734650000000004 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760037+0000", 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5739999999999998e-05 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760078+0000", 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1056999999999997e-05 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:59627 5.4 5:2ea3ff41:::benchmark_data_smithi070_97781_object59626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.885070+0000", 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.028871763000000002, 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015219217, 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:38.132 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 59627 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885070+0000", 2023-07-29T16:38:38.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885070+0000", 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885070+0000", 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885185+0000", 2023-07-29T16:38:38.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011576199999999999 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885196+0000", 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0227000000000001e-05 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.885204+0000", 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9629999999999998e-06 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.886810+0000", 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001606721 2023-07-29T16:38:38.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.886958+0000", 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014802199999999999 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.887089+0000", 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013111500000000001 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.889078+0000", 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019887310000000001 2023-07-29T16:38:38.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.900234+0000", 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011155981000000001 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:38.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.900264+0000", 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9450000000000001e-05 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.900290+0000", 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6137000000000001e-05 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:38.142 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:38.142 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:38.143 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 22 16 60029 60013 170.477 135.438 0.00714982 0.00586314 2023-07-29T16:38:38.144 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:38.140+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:38.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:38.245 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:38.242+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:38.319 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60554 5.1 5:8760b5a7:::benchmark_data_smithi070_97781_object60553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.312122+0000", 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0045690230000000002, 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045884029999999996, 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60554 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312122+0000", 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312122+0000", 2023-07-29T16:38:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312121+0000", 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312192+0000", 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0229999999999997e-05 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312204+0000", 2023-07-29T16:38:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2143e-05 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312209+0000", 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9370000000000003e-06 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314149+0000", 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001940233 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314259+0000", 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109648 2023-07-29T16:38:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314367+0000", 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010825899999999999 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60555 5.7 5:e9541e6b:::benchmark_data_smithi070_97781_object60554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.312213+0000", 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0044776690000000001, 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045471349999999999, 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60555 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312213+0000", 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312213+0000", 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312213+0000", 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312270+0000", 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6555000000000003e-05 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312277+0000", 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8460000000000002e-06 2023-07-29T16:38:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312280+0000", 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3960000000000002e-06 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312324+0000", 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3868000000000001e-05 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312398+0000", 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4048999999999995e-05 2023-07-29T16:38:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312478+0000", 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0317999999999999e-05 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315977+0000", 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034988720000000001 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60557 5.f 5:f52dd61b:::benchmark_data_smithi070_97781_object60556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.313852+0000", 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002839037, 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029546970000000001, 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60557 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313852+0000", 2023-07-29T16:38:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313852+0000", 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313851+0000", 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313945+0000", 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3991000000000002e-05 2023-07-29T16:38:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313955+0000", 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7599999999999997e-06 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.313963+0000", 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1599999999999998e-06 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314234+0000", 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000270423 2023-07-29T16:38:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314332+0000", 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8505000000000006e-05 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314415+0000", 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2811000000000004e-05 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:60559 5.d e34/19 5:b9f8d4a9:::benchmark_data_smithi070_97781_object60558:head v 34'3753, mlcod=34'3751)", 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.314170+0000", 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0025215390000000002, 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026785149999999998, 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314170+0000", 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314170+0000", 2023-07-29T16:38:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314169+0000", 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314232+0000", 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3297000000000001e-05 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314241+0000", 2023-07-29T16:38:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0510000000000002e-06 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314248+0000", 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314280+0000", 2023-07-29T16:38:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2106000000000001e-05 2023-07-29T16:38:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314292+0000", 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2442999999999999e-05 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:60548 5.f e34/19 ondisk, result = 0)", 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.314260+0000", 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0024310780000000001, 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026194149999999999, 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314260+0000", 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314260+0000", 2023-07-29T16:38:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314260+0000", 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314263+0000", 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8710000000000001e-06 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314268+0000", 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8080000000000001e-06 2023-07-29T16:38:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314273+0000", 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6419999999999998e-06 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315976+0000", 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001703448 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315982+0000", 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.032e-06 2023-07-29T16:38:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60561 5.1 5:860cfae5:::benchmark_data_smithi070_97781_object60560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.314535+0000", 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0021556769999999999, 2023-07-29T16:38:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023787729999999998, 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60561 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314535+0000", 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314535+0000", 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314535+0000", 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314593+0000", 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8799999999999999e-05 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314603+0000", 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8020000000000003e-06 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314610+0000", 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5590000000000002e-06 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315879+0000", 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001269526 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315973+0000", 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3807999999999994e-05 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316098+0000", 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012515900000000001 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60562 5.f 5:f792397d:::benchmark_data_smithi070_97781_object60561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.314616+0000", 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002075099, 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002339383, 2023-07-29T16:38:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60562 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314616+0000", 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314616+0000", 2023-07-29T16:38:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314616+0000", 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314648+0000", 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2589000000000003e-05 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314655+0000", 2023-07-29T16:38:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6889999999999998e-06 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314660+0000", 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9080000000000003e-06 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316015+0000", 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001355087 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316160+0000", 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000145606 2023-07-29T16:38:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316319+0000", 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015824099999999999 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:60557 5.f e34/19)", 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.316387+0000", 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00030427600000000003, 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00060812099999999999, 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316387+0000", 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316387+0000", 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316386+0000", 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316390+0000", 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7780000000000001e-06 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316397+0000", 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4230000000000002e-06 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316403+0000", 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1279999999999996e-06 2023-07-29T16:38:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:60563 5.6 e34/19 5:61180519:::benchmark_data_smithi070_97781_object60562:head v 34'3638, mlcod=34'3636)", 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.316465+0000", 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00022570000000000001, 2023-07-29T16:38:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00055590999999999995, 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316465+0000", 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316465+0000", 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316465+0000", 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316516+0000", 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1310000000000002e-05 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316523+0000", 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1080000000000004e-06 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316528+0000", 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.476e-06 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316561+0000", 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2938999999999998e-05 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.316579+0000", 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8212000000000001e-05 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60548 5.f 5:f51a765a:::benchmark_data_smithi070_97781_object60547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.309889+0000", 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0068020789999999999, 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0071689500000000003, 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60548 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309889+0000", 2023-07-29T16:38:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309889+0000", 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309888+0000", 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309915+0000", 2023-07-29T16:38:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7016e-05 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309926+0000", 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1194e-05 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309934+0000", 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4429999999999997e-06 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.309960+0000", 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6089999999999999e-05 2023-07-29T16:38:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310050+0000", 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0507000000000006e-05 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310133+0000", 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2645999999999994e-05 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315989+0000", 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058556459999999999 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60550 5.1 5:85f91c0f:::benchmark_data_smithi070_97781_object60549:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.310351+0000", 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.006340516, 2023-07-29T16:38:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067522370000000003, 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60550 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310351+0000", 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310351+0000", 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310350+0000", 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310416+0000", 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5686999999999996e-05 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310427+0000", 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.129e-05 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.310434+0000", 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1899999999999998e-06 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311818+0000", 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013842469999999999 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311906+0000", 2023-07-29T16:38:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7872000000000002e-05 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312032+0000", 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012634000000000001 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.314134+0000", 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021016120000000001 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:60551 5.9 5:9fcc07c3:::benchmark_data_smithi070_97781_object60550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.311818+0000", 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0048729059999999998, 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053293519999999999, 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 60551 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311818+0000", 2023-07-29T16:38:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311818+0000", 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311817+0000", 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311889+0000", 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1307e-05 2023-07-29T16:38:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311912+0000", 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3079999999999999e-05 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311919+0000", 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1840000000000002e-06 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.311953+0000", 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3924999999999998e-05 2023-07-29T16:38:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312062+0000", 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010917999999999999 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.312191+0000", 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012865000000000001 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.315783+0000", 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003592601 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 12 2023-07-29T16:38:38.411 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:38.412 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:38.409+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:38.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:38.513 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:38.511+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:38:38.589 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:38.590 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:38.590 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:38.590 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:38.590 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:38.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:38.614 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:38.611+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:38.716 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:38.713+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:38.815 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:38.815 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:38.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:38.816 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:38.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.816 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:38.816 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:38.817 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 56.289079458000003, 2023-07-29T16:38:38.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:38.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.817 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:38.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:38.818 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:38.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.819 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:38.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:38.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:38.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:38.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:38.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:38.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:38.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:38.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:38.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:38.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:38.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:38.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:38.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:38.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:38.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:38.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:38.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:38.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:38.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:38.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:38.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:38.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:38.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:38.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:38.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:38.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:38.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:38.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:38.839 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.839 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.839 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.840 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.840 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:38.840 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.864122477000002, 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:38.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:38.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:38.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:38.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:38.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:38.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:38.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:38.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:38.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:38.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:38.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:38.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:38.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:38.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:38.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.856 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.864097622000003, 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:38.857 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:38.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:38.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:38.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:38.867 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:38.868 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.864065678000003, 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:38.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:38.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:38.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:38.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.864044067000002, 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:38.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:38.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:38.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:38.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:38.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.864020007000001, 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:38.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:38.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.901 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863984858999999, 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:38.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:38.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:38.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:38.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.912 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863948745000002, 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:38.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:38.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:38.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863923841999998, 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:38.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:38.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:38.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863868869000001, 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.016682276999999999, 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:38.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946698+0000", 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946704+0000", 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9150000000000001e-06 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946710+0000", 2023-07-29T16:38:38.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0839999999999997e-06 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946716+0000", 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2500000000000003e-06 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947483+0000", 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076636 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947490+0000", 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5159999999999997e-06 2023-07-29T16:38:38.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955416+0000", 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079259350000000003 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955501+0000", 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4853999999999998e-05 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955646+0000", 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014486100000000001 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958407+0000", 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002761313 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963205+0000", 2023-07-29T16:38:38.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047977369999999998 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963344+0000", 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000138796 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963381+0000", 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7058000000000003e-05 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863801551999998, 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:38.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:38.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:38.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863776633000001, 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:38.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863725090000003, 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:38.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:38.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:38.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863677506000002, 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.979 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:38.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:38.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:38.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.989 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.863654220000001, 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:38.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:38.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:38.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:38.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:38.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:59921 5.7 5:ecfeab76:::benchmark_data_smithi070_97781_object59920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:38.998 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.78774273100000003, 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018023232, 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:38.999 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 59921 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:39.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022845+0000", 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1282000000000001e-05 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022851+0000", 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022854+0000", 2023-07-29T16:38:39.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.506e-06 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027040+0000", 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041851910000000004 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027131+0000", 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1481e-05 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027224+0000", 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2925999999999998e-05 2023-07-29T16:38:39.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.035723+0000", 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0084984220000000003 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:39.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040758+0000", 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050352360000000002 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040808+0000", 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0466000000000001e-05 2023-07-29T16:38:39.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040848+0000", 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9511999999999997e-05 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61116 5.1 5:83f1337b:::benchmark_data_smithi070_97781_object61115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.23377935899999999, 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017176276000000001, 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:39.009 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61116 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:39.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576787+0000", 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:39.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576878+0000", 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0397999999999997e-05 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576887+0000", 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9299999999999992e-06 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576892+0000", 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9840000000000001e-06 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.578771+0000", 2023-07-29T16:38:39.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001879447 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.578878+0000", 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107064 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.579028+0000", 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150323 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.588964+0000", 2023-07-29T16:38:39.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357019999999994 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593899+0000", 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049349759999999998 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593938+0000", 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8707000000000001e-05 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593964+0000", 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6347e-05 2023-07-29T16:38:39.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61411 5.f 5:f97c8622:::benchmark_data_smithi070_97781_object61410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.098108668999999996, 2023-07-29T16:38:39.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018542692, 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61411 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712458+0000", 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712525+0000", 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6715000000000001e-05 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:39.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712534+0000", 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2920000000000001e-06 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712541+0000", 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712589+0000", 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8489999999999998e-05 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712724+0000", 2023-07-29T16:38:39.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134208 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712894+0000", 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170471 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727900+0000", 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015006143 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730936+0000", 2023-07-29T16:38:39.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030355849999999999 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730971+0000", 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731001+0000", 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0267999999999999e-05 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.029 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61419 5.f 5:f0534ab8:::benchmark_data_smithi070_97781_object61418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.092755808999999995, 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018012489999999999, 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:39.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61419 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:39.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717842+0000", 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0868000000000003e-05 2023-07-29T16:38:39.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717850+0000", 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3080000000000008e-06 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717857+0000", 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3790000000000003e-06 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.724902+0000", 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070455149999999996 2023-07-29T16:38:39.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725049+0000", 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014657400000000001 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:39.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725202+0000", 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015374400000000001 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731053+0000", 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058501719999999998 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735779+0000", 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047264890000000004 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735806+0000", 2023-07-29T16:38:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7440000000000002e-05 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735824+0000", 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7438000000000001e-05 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61420 5.7 5:ef4ebe24:::benchmark_data_smithi070_97781_object61419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.092611393, 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017443556999999998, 2023-07-29T16:38:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61420 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:39.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:39.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717955+0000", 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718009+0000", 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3974000000000002e-05 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718017+0000", 2023-07-29T16:38:39.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2139999999999999e-06 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718022+0000", 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3449999999999996e-06 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727958+0000", 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357100000000004 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728039+0000", 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1358000000000003e-05 2023-07-29T16:38:39.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728132+0000", 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3552000000000001e-05 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735340+0000", 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.007207677 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735345+0000", 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4379999999999997e-06 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735375+0000", 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0236e-05 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735399+0000", 2023-07-29T16:38:39.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4544000000000001e-05 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:39.050 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:39.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:39.052 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:39.048+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:39.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 23 16 62196 62180 168.953 135.438 0.00455632 0.0059159 2023-07-29T16:38:39.152 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:39.150+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:39.240 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:39.240 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:39.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62502 5.8 e35/19 5:13842438:::benchmark_data_smithi070_97781_object62501:head v 35'3907, mlcod=35'3904)", 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.229962+0000", 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0068016680000000003, 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068276170000000002, 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229962+0000", 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229962+0000", 2023-07-29T16:38:39.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229961+0000", 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230161+0000", 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019955 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230169+0000", 2023-07-29T16:38:39.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3639999999999999e-06 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230175+0000", 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3240000000000002e-06 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230243+0000", 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8120000000000005e-05 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230261+0000", 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8405000000000001e-05 2023-07-29T16:38:39.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62504 5.1 e35/19 5:80909119:::benchmark_data_smithi070_97781_object62503:head v 35'3948, mlcod=35'3945)", 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.232007+0000", 2023-07-29T16:38:39.247 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047564959999999998, 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048553140000000003, 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232007+0000", 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232007+0000", 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232007+0000", 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232062+0000", 2023-07-29T16:38:39.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5565000000000001e-05 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232072+0000", 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3680000000000008e-06 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232078+0000", 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9000000000000003e-06 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232136+0000", 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8517999999999998e-05 2023-07-29T16:38:39.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232202+0000", 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6180999999999995e-05 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236857+0000", 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046547680000000001 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.254 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62506 5.0 e35/19 5:0e12ff7d:::benchmark_data_smithi070_97781_object62505:head v 35'3984, mlcod=35'3980)", 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.233186+0000", 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035779549999999999, 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037818180000000002, 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233186+0000", 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233186+0000", 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233185+0000", 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233284+0000", 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9370000000000006e-05 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233294+0000", 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6560000000000004e-06 2023-07-29T16:38:39.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233301+0000", 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4649999999999999e-06 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233333+0000", 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2257e-05 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233351+0000", 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482e-05 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.260 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62507 5.c 5:330df011:::benchmark_data_smithi070_97781_object62506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.233203+0000", 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035602530000000002, 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038316100000000001, 2023-07-29T16:38:39.261 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62507 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233203+0000", 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233203+0000", 2023-07-29T16:38:39.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233202+0000", 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:39.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233340+0000", 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013781399999999999 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233349+0000", 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1649999999999995e-06 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233359+0000", 2023-07-29T16:38:39.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5060000000000001e-06 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233394+0000", 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233537+0000", 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014295099999999999 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233667+0000", 2023-07-29T16:38:39.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013033700000000001 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62510 5.c 5:3635a79d:::benchmark_data_smithi070_97781_object62509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.269 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.233437+0000", 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0033265830000000001, 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036768479999999999, 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.270 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62510 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233437+0000", 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233437+0000", 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233437+0000", 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233488+0000", 2023-07-29T16:38:39.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1687999999999997e-05 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233496+0000", 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3440000000000003e-06 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233502+0000", 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4250000000000003e-06 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235653+0000", 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002151259 2023-07-29T16:38:39.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235794+0000", 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140636 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:39.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235963+0000", 2023-07-29T16:38:39.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016891000000000001 2023-07-29T16:38:39.277 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.277 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.278 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.279 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62512 5.5 5:ae078106:::benchmark_data_smithi070_97781_object62511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.279 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.233567+0000", 2023-07-29T16:38:39.279 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031967639999999999, 2023-07-29T16:38:39.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036242359999999999, 2023-07-29T16:38:39.280 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.280 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:39.280 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.280 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.281 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.281 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62512 2023-07-29T16:38:39.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.282 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233567+0000", 2023-07-29T16:38:39.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233567+0000", 2023-07-29T16:38:39.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233566+0000", 2023-07-29T16:38:39.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233669+0000", 2023-07-29T16:38:39.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010306000000000001 2023-07-29T16:38:39.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233689+0000", 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9942e-05 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233706+0000", 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6325e-05 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233752+0000", 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.634e-05 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233865+0000", 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011288700000000001 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.233995+0000", 2023-07-29T16:38:39.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012985199999999999 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236742+0000", 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027474119999999999 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62515 5.8 e35/19 5:14d31234:::benchmark_data_smithi070_97781_object62514:head v 35'3908, mlcod=35'3905)", 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.234365+0000", 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0023986789999999999, 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029136909999999999, 2023-07-29T16:38:39.292 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234365+0000", 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234365+0000", 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234358+0000", 2023-07-29T16:38:39.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999928 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234413+0000", 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4626000000000002e-05 2023-07-29T16:38:39.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234425+0000", 2023-07-29T16:38:39.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2442e-05 2023-07-29T16:38:39.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.234432+0000", 2023-07-29T16:38:39.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5529999999999998e-06 2023-07-29T16:38:39.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235110+0000", 2023-07-29T16:38:39.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067807700000000002 2023-07-29T16:38:39.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235129+0000", 2023-07-29T16:38:39.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9100999999999999e-05 2023-07-29T16:38:39.301 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.301 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.301 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.302 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62516 5.0 e35/19 5:095c78a0:::benchmark_data_smithi070_97781_object62515:head v 35'3985, mlcod=35'3982)", 2023-07-29T16:38:39.302 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.235950+0000", 2023-07-29T16:38:39.303 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00081354099999999998, 2023-07-29T16:38:39.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013937579999999999, 2023-07-29T16:38:39.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.304 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:39.304 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235950+0000", 2023-07-29T16:38:39.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235950+0000", 2023-07-29T16:38:39.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.235949+0000", 2023-07-29T16:38:39.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236009+0000", 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9985000000000003e-05 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236021+0000", 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1301000000000001e-05 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236029+0000", 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8460000000000008e-06 2023-07-29T16:38:39.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237211+0000", 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001182202 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237228+0000", 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7229000000000001e-05 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.311 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.312 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62517 5.b e35/19 5:d08fda91:::benchmark_data_smithi070_97781_object62516:head v 35'3939, mlcod=35'3937)", 2023-07-29T16:38:39.312 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.236036+0000", 2023-07-29T16:38:39.312 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00072812199999999999, 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001365815, 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236036+0000", 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236036+0000", 2023-07-29T16:38:39.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236035+0000", 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236073+0000", 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7333000000000003e-05 2023-07-29T16:38:39.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236080+0000", 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.464e-06 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236086+0000", 2023-07-29T16:38:39.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.806e-06 2023-07-29T16:38:39.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236122+0000", 2023-07-29T16:38:39.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5893999999999999e-05 2023-07-29T16:38:39.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236141+0000", 2023-07-29T16:38:39.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8831999999999999e-05 2023-07-29T16:38:39.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.321 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.322 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.322 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62519 5.a 5:5148e14a:::benchmark_data_smithi070_97781_object62518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.323 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.236475+0000", 2023-07-29T16:38:39.323 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00028840099999999998, 2023-07-29T16:38:39.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098753399999999998, 2023-07-29T16:38:39.323 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62519 2023-07-29T16:38:39.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.325 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236475+0000", 2023-07-29T16:38:39.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236475+0000", 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236474+0000", 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236518+0000", 2023-07-29T16:38:39.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3591999999999999e-05 2023-07-29T16:38:39.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236543+0000", 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5134e-05 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236563+0000", 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9868999999999999e-05 2023-07-29T16:38:39.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236604+0000", 2023-07-29T16:38:39.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2023-07-29T16:38:39.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236752+0000", 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014782 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:39.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236851+0000", 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9109000000000003e-05 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.332 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62520 5.a 5.837484ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.236583+0000", 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00018037700000000001, 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00095190300000000004, 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62520 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236583+0000", 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236583+0000", 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236583+0000", 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236614+0000", 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1372999999999999e-05 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236623+0000", 2023-07-29T16:38:39.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8899999999999996e-06 2023-07-29T16:38:39.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.236634+0000", 2023-07-29T16:38:39.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1191e-05 2023-07-29T16:38:39.339 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.339 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.339 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62521 5.2 e35/19)", 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.237099+0000", 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9996648, 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052374400000000003, 2023-07-29T16:38:39.340 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.341 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:39.341 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237099+0000", 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237099+0000", 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237098+0000", 2023-07-29T16:38:39.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237172+0000", 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3407999999999999e-05 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237183+0000", 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1319e-05 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237189+0000", 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3230000000000003e-06 2023-07-29T16:38:39.345 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4749.0:62507 5.c e35/19)", 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.237463+0000", 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9993005, 2023-07-29T16:38:39.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021238799999999999, 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237463+0000", 2023-07-29T16:38:39.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237463+0000", 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237463+0000", 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237466+0000", 2023-07-29T16:38:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3919999999999999e-06 2023-07-29T16:38:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237476+0000", 2023-07-29T16:38:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7559999999999994e-06 2023-07-29T16:38:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237483+0000", 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2280000000000001e-06 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62523 5.3 5:c67531e1:::benchmark_data_smithi070_97781_object62522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.237652+0000", 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9991121, 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130488, 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.353 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62523 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237652+0000", 2023-07-29T16:38:39.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237652+0000", 2023-07-29T16:38:39.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237651+0000", 2023-07-29T16:38:39.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:39.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237678+0000", 2023-07-29T16:38:39.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6614999999999998e-05 2023-07-29T16:38:39.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237687+0000", 2023-07-29T16:38:39.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0049999999999993e-06 2023-07-29T16:38:39.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237693+0000", 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5069999999999997e-06 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237726+0000", 2023-07-29T16:38:39.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2589000000000003e-05 2023-07-29T16:38:39.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.362 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62522 5.4 e35/19)", 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.237710+0000", 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9990535, 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013937699999999999, 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.363 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237710+0000", 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237710+0000", 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237710+0000", 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237738+0000", 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8136e-05 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237745+0000", 2023-07-29T16:38:39.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7299999999999999e-06 2023-07-29T16:38:39.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237749+0000", 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.831e-06 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.368 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:62518 5.8 e35/19)", 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.237754+0000", 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9990096, 2023-07-29T16:38:39.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176725, 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237754+0000", 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237754+0000", 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237754+0000", 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967296 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237784+0000", 2023-07-29T16:38:39.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0173999999999999e-05 2023-07-29T16:38:39.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237790+0000", 2023-07-29T16:38:39.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1979999999999998e-06 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.237794+0000", 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1899999999999997e-06 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:62505 5.c 5:37b4de58:::benchmark_data_smithi070_97781_object62504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:39.229992+0000", 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0067722060000000002, 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008010873, 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:39.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 62505 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:39.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229992+0000", 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229992+0000", 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:39.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.229990+0000", 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230111+0000", 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120691 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230122+0000", 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0396e-05 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230129+0000", 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2529999999999998e-06 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230183+0000", 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4116000000000002e-05 2023-07-29T16:38:39.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230316+0000", 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133251 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:39.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.230460+0000", 2023-07-29T16:38:39.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014373599999999999 2023-07-29T16:38:39.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:39.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.232695+0000", 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022348789999999999 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:39.238007+0000", 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053121219999999999 2023-07-29T16:38:39.384 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 17 2023-07-29T16:38:39.385 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:39.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:39.387 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.384+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:39.487 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.484+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:39.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:39.575 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:39.576 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:39.576 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:39.576 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:39.576 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:39.587 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.585+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:39.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:39.680 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:39.688 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.685+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:39.700 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:39.722 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:39.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:39.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:39.724 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:39.783 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:39.784 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:39.789 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.786+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:39.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:39.890 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:39.887+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:39.965 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:39.965 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:39.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:39.991 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:39.988+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:40.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 24 16 64286 64270 167.356 130.625 0.00369077 0.00597254 2023-07-29T16:38:40.093 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:40.089+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:40.189 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:40.189 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:40.192 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:40.189+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:40.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:40.293 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:40.291+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:40.394 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:40.392+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:40.413 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:40.413 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:40.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:40.497 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:40.494+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:40.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:38:40.597 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:40.597 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:40.598 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:40.593+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:40.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:40.697 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:40.694+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:40.798 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:40.795+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:40.821 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:40.822 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:40.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:40.899 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:40.896+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:41.000 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:40.997+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:41.008 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:41.009 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:41.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:41.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 25 16 66440 66424 166.046 134.625 0.00842224 0.00601976 2023-07-29T16:38:41.100 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:41.098+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:41.201 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:41.198+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:41.207 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:41.207 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:41.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:41.302 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:41.300+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:41.403 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:41.401+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:41.446 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:41.447 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:41.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:41.507 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:41.504+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:41.532 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:41.533 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:41.533 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T16:38:41.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:38:41.534 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:38:41.605 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:41.602+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:41.649 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:41.649 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:41.665 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:41.707 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:41.704+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:41.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:41.808 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:41.805+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:41.831 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:41.831 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:41.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:38:41.523470+0000", 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:37:40.281964+0000", 2023-07-29T16:38:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2023-07-29T16:38:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:38:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 5, 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2023-07-29T16:38:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:38:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:38:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:38:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2023-07-29T16:38:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:38:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:38:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:38:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:38:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:38:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:38:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:38:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:38:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:38:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:38:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:38:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "unique_pool_0", 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:38:13.069639+0000", 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:38:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:38:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 16, 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 16, 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 16, 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 16, 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 16, 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:38:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:38:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:38:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:38:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:38:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "rados": {} 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:38:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:38:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 27, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:38:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:38:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:38:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:38:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:38:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 33, 2023-07-29T16:38:41.973 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:38:41.974 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:38:41.976 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:38:41.978 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.980 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:41.980 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.981 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:38:41.981 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.982 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:38:41.982 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:38:41.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.983 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:38:41.984 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:38:41.984 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:38:41.984 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:38:41.985 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:41.985 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:41.985 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:41.987 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:38:41.987 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:38:41.988 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:38:41.988 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:38:41.988 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:38:41.988 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:38:41.989 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:38:41.989 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:38:41.989 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:38:41.989 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:38:41.989 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:38:41.990 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:38:41.990 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.991 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:38:41.991 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.993 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.995 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:38:41.997 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:38:41.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:38:41.999 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:38:42.000 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:38:42.000 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:38:42.000 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:38:42.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:42.001 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:42.002 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:38:42.003 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:42.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:42.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:38:42.004 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:38:42.004 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:38:42.004 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:38:42.005 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:38:42.005 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:38:42.005 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:38:42.006 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:38:42.006 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:38:42.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:42.006 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2023-07-29T16:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:38:42.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:38:42.013 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:38:42.013 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:42.015 INFO:tasks.thrashosds.thrasher:j is {'epoch': 36, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:38:41.523470+0000', 'last_up_change': '2023-07-29T16:37:40.281964+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-07-29T16:38:13.069639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:38:42.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:38:42.016 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:42.016 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:42.017 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:42.017 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:42.017 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:42.018 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:42.019 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:42.019 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:42.011+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:42.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:42.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 26 16 68522 68506 164.664 130.125 0.0101368 0.00606992 2023-07-29T16:38:42.114 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:42.112+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:42.194 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:42.194 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:42.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.243250420000003, 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:42.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242949435, 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.207 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:42.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:42.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:42.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:42.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:42.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242916680999997, 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:42.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:42.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:42.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:42.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:42.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.230 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:42.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242885800000003, 2023-07-29T16:38:42.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:42.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:42.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:42.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:42.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:42.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:42.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:42.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:42.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:42.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:42.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:42.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:42.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:42.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:42.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:42.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:42.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:42.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242864429999997, 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:42.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:42.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:42.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:42.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:42.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:42.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:42.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:42.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:42.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:42.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:42.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:42.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:42.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.264 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242829983999997, 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:42.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:42.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:42.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:42.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:42.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:42.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:42.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:42.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:42.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:42.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.277 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.278 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.278 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242808306999997, 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:42.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:42.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:42.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:42.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:42.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.242329929, 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:42.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:42.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:42.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:42.298 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.675242648000001, 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:42.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:42.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27884 5.e 5:7df06602:::benchmark_data_smithi070_97781_object27883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.674921452, 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015390623000000001, 2023-07-29T16:38:42.309 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27884 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515640+0000", 2023-07-29T16:38:42.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515639+0000", 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515693+0000", 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515702+0000", 2023-07-29T16:38:42.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8009999999999998e-06 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515708+0000", 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6500000000000001e-06 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516811+0000", 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011030370000000001 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.516934+0000", 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2023-07-29T16:38:42.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517091+0000", 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015713000000000001 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520518+0000", 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034265049999999998 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530982+0000", 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010464141 2023-07-29T16:38:42.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531011+0000", 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-05 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531030+0000", 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9394000000000001e-05 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27886 5.e 5:7783bbaa:::benchmark_data_smithi070_97781_object27885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:42.319 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.674679191999999, 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015423605999999999, 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27886 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515882+0000", 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515881+0000", 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515909+0000", 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8283999999999999e-05 2023-07-29T16:38:42.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515915+0000", 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515919+0000", 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9060000000000004e-06 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.517921+0000", 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002002078 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518055+0000", 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013362000000000001 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.518215+0000", 2023-07-29T16:38:42.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015999800000000001 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520523+0000", 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023083040000000002 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531225+0000", 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701657 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531269+0000", 2023-07-29T16:38:42.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4561999999999998e-05 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.531305+0000", 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6035000000000003e-05 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.329 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.388772225, 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.330 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:42.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:42.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:42.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:42.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.340 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39119 5.b 5:d24c1e56:::benchmark_data_smithi070_97781_object39118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.161969768000001, 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015792800999999999, 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39119 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028631+0000", 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0861000000000001e-05 2023-07-29T16:38:42.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028657+0000", 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5624999999999999e-05 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028671+0000", 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030170+0000", 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014990820000000001 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030302+0000", 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013176900000000001 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030437+0000", 2023-07-29T16:38:42.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013460600000000001 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032638+0000", 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022014700000000001 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044293+0000", 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011655341 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044343+0000", 2023-07-29T16:38:42.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0065000000000003e-05 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044384+0000", 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0528999999999998e-05 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:59315 5.4 5:26dd69f8:::benchmark_data_smithi070_97781_object59314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4469015929999998, 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016419021999999998, 2023-07-29T16:38:42.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 59315 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743688+0000", 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9192000000000001e-05 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743695+0000", 2023-07-29T16:38:42.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1770000000000001e-06 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743702+0000", 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1760000000000004e-06 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750657+0000", 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069546260000000002 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750749+0000", 2023-07-29T16:38:42.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2001000000000002e-05 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750839+0000", 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0304999999999997e-05 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.754808+0000", 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039689149999999999 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.759982+0000", 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051734650000000004 2023-07-29T16:38:42.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760037+0000", 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5739999999999998e-05 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760078+0000", 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1056999999999997e-05 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.361 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:60083 5.0 5:0130d468:::benchmark_data_smithi070_97781_object60082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0922573289999997, 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016688729999999999, 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 60083 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098303+0000", 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098356+0000", 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3090999999999997e-05 2023-07-29T16:38:42.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098380+0000", 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4309000000000001e-05 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098387+0000", 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3500000000000002e-06 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103602+0000", 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052149989999999997 2023-07-29T16:38:42.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103722+0000", 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119986 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103853+0000", 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013117900000000001 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.107161+0000", 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033084910000000002 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114913+0000", 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077511280000000004 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114954+0000", 2023-07-29T16:38:42.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1559e-05 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114992+0000", 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8207000000000002e-05 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61556 5.0 5:08bd3317:::benchmark_data_smithi070_97781_object61555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.4073236819999999, 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017549391000000001, 2023-07-29T16:38:42.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61556 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:42.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783324+0000", 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7179e-05 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783333+0000", 2023-07-29T16:38:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3989999999999993e-06 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783341+0000", 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.559e-06 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786440+0000", 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030994249999999998 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786528+0000", 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8051000000000001e-05 2023-07-29T16:38:42.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786612+0000", 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3523000000000007e-05 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.793067+0000", 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064551909999999999 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800708+0000", 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007640829 2023-07-29T16:38:42.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800752+0000", 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3937999999999998e-05 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800787+0000", 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5012000000000003e-05 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61557 5.0 5:0a5a1aa5:::benchmark_data_smithi070_97781_object61556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:42.382 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.4066898559999998, 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017588416999999999, 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61557 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783870+0000", 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783938+0000", 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7959000000000004e-05 2023-07-29T16:38:42.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783947+0000", 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2800000000000003e-06 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783956+0000", 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2760000000000006e-06 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788070+0000", 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041141149999999998 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788209+0000", 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013932199999999999 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788345+0000", 2023-07-29T16:38:42.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135919 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.793772+0000", 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054271720000000001 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801387+0000", 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076141869999999997 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801426+0000", 2023-07-29T16:38:42.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9619999999999997e-05 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801460+0000", 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3235999999999998e-05 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61559 5.8 5:1d4b7aba:::benchmark_data_smithi070_97781_object61558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.4057923369999998, 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016043330000000001, 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61559 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:42.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784768+0000", 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784895+0000", 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012731600000000001 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784905+0000", 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8810000000000008e-06 2023-07-29T16:38:42.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784913+0000", 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0819999999999999e-06 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789657+0000", 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047439099999999996 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789732+0000", 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5139e-05 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789811+0000", 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8141999999999998e-05 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796577+0000", 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067661589999999999 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800742+0000", 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041655520000000003 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800785+0000", 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2403e-05 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800812+0000", 2023-07-29T16:38:42.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7263e-05 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61571 5.0 5:03d28ec5:::benchmark_data_smithi070_97781_object61570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:42.403 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3994458189999999, 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016130768, 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61571 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791114+0000", 2023-07-29T16:38:42.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791174+0000", 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9293999999999998e-05 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791190+0000", 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6311999999999999e-05 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791201+0000", 2023-07-29T16:38:42.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1358e-05 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791241+0000", 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9863000000000001e-05 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791365+0000", 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012344799999999999 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791490+0000", 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124912 2023-07-29T16:38:42.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796632+0000", 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051424649999999997 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807150+0000", 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010517548999999999 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807204+0000", 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4191999999999999e-05 2023-07-29T16:38:42.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807246+0000", 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2073000000000002e-05 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61572 5.8 5:192310c5:::benchmark_data_smithi070_97781_object61571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3993367170000002, 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016021662999999998, 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61572 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:42.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791211+0000", 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999871 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:42.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791262+0000", 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1143000000000001e-05 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791268+0000", 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791273+0000", 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7709999999999997e-06 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:42.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791356+0000", 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3805000000000001e-05 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791442+0000", 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5711000000000007e-05 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791530+0000", 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8279e-05 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796620+0000", 2023-07-29T16:38:42.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050891139999999996 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807135+0000", 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010515678000000001 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807202+0000", 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7039999999999995e-05 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807246+0000", 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3637000000000003e-05 2023-07-29T16:38:42.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:42.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:42.424 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:42.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:42.427 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:42.422+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:38:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:38:42.431 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-07-29T16:38:41.527002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4277013338,"num_objects":65277,"num_object_clones":0,"num_object_copies":130554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65277,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":65501,"num_write_kb":4179666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60849,"ondisk_log_size":60849,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":760748,"kb_used_data":516688,"kb_used_omap":0,"kb_used_meta":244032,"kb_avail":282354772,"statfs":{"total":289910292480,"available":289131286528,"internally_reserved":0,"allocated":529088512,"data_stored":8446622631,"data_compressed":40460256,"data_compressed_allocated":527888384,"data_compressed_original":8446181376,"omap_allocated":0,"internal_metadata":249888768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,7,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708640768,"num_objects":10813,"num_object_clones":0,"num_object_copies":21626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10813,"num_write_kb":692032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.013056"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.531018+0000","last_change":"2023-07-29T16:37:53.953623+0000","last_active":"2023-07-29T16:38:37.531018+0000","last_peered":"2023-07-29T16:38:37.531018+0000","last_clean":"2023-07-29T16:38:37.531018+0000","last_became_active":"2023-07-29T16:37:53.953187+0000","last_became_peered":"2023-07-29T16:37:53.953187+0000","last_unstale":"2023-07-29T16:38:37.531018+0000","last_undegraded":"2023-07-29T16:38:37.531018+0000","last_fullsized":"2023-07-29T16:38:37.531018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530486+0000","last_change":"2023-07-29T16:37:53.958250+0000","last_active":"2023-07-29T16:38:37.530486+0000","last_peered":"2023-07-29T16:38:37.530486+0000","last_clean":"2023-07-29T16:38:37.530486+0000","last_became_active":"2023-07-29T16:37:53.956994+0000","last_became_peered":"2023-07-29T16:37:53.956994+0000","last_unstale":"2023-07-29T16:38:37.530486+0000","last_undegraded":"2023-07-29T16:38:37.530486+0000","last_fullsized":"2023-07-29T16:38:37.530486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527428+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:38:37.527428+0000","last_peered":"2023-07-29T16:38:37.527428+0000","last_clean":"2023-07-29T16:38:37.527428+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:38:37.527428+0000","last_undegraded":"2023-07-29T16:38:37.527428+0000","last_fullsized":"2023-07-29T16:38:37.527428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527384+0000","last_change":"2023-07-29T16:37:53.957536+0000","last_active":"2023-07-29T16:38:37.527384+0000","last_peered":"2023-07-29T16:38:37.527384+0000","last_clean":"2023-07-29T16:38:37.527384+0000","last_became_active":"2023-07-29T16:37:53.956853+0000","last_became_peered":"2023-07-29T16:37:53.956853+0000","last_unstale":"2023-07-29T16:38:37.527384+0000","last_undegraded":"2023-07-29T16:38:37.527384+0000","last_fullsized":"2023-07-29T16:38:37.527384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:48:11.736514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530326+0000","last_change":"2023-07-29T16:37:53.952254+0000","last_active":"2023-07-29T16:38:37.530326+0000","last_peered":"2023-07-29T16:38:37.530326+0000","last_clean":"2023-07-29T16:38:37.530326+0000","last_became_active":"2023-07-29T16:37:53.950844+0000","last_became_peered":"2023-07-29T16:37:53.950844+0000","last_unstale":"2023-07-29T16:38:37.530326+0000","last_undegraded":"2023-07-29T16:38:37.530326+0000","last_fullsized":"2023-07-29T16:38:37.530326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526995+0000","last_change":"2023-07-29T16:37:53.955973+0000","last_active":"2023-07-29T16:38:37.526995+0000","last_peered":"2023-07-29T16:38:37.526995+0000","last_clean":"2023-07-29T16:38:37.526995+0000","last_became_active":"2023-07-29T16:37:53.955458+0000","last_became_peered":"2023-07-29T16:37:53.955458+0000","last_unstale":"2023-07-29T16:38:37.526995+0000","last_undegraded":"2023-07-29T16:38:37.526995+0000","last_fullsized":"2023-07-29T16:38:37.526995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:24:10.343443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527407+0000","last_change":"2023-07-29T16:37:53.959670+0000","last_active":"2023-07-29T16:38:37.527407+0000","last_peered":"2023-07-29T16:38:37.527407+0000","last_clean":"2023-07-29T16:38:37.527407+0000","last_became_active":"2023-07-29T16:37:53.959366+0000","last_became_peered":"2023-07-29T16:37:53.959366+0000","last_unstale":"2023-07-29T16:38:37.527407+0000","last_undegraded":"2023-07-29T16:38:37.527407+0000","last_fullsized":"2023-07-29T16:38:37.527407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:40:36.485888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.525867+0000","last_change":"2023-07-29T16:37:53.961616+0000","last_active":"2023-07-29T16:38:37.525867+0000","last_peered":"2023-07-29T16:38:37.525867+0000","last_clean":"2023-07-29T16:38:37.525867+0000","last_became_active":"2023-07-29T16:37:53.960647+0000","last_became_peered":"2023-07-29T16:37:53.960647+0000","last_unstale":"2023-07-29T16:38:37.525867+0000","last_undegraded":"2023-07-29T16:38:37.525867+0000","last_fullsized":"2023-07-29T16:38:37.525867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:49.929315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529411+0000","last_change":"2023-07-29T16:37:53.959236+0000","last_active":"2023-07-29T16:38:37.529411+0000","last_peered":"2023-07-29T16:38:37.529411+0000","last_clean":"2023-07-29T16:38:37.529411+0000","last_became_active":"2023-07-29T16:37:53.957438+0000","last_became_peered":"2023-07-29T16:37:53.957438+0000","last_unstale":"2023-07-29T16:38:37.529411+0000","last_undegraded":"2023-07-29T16:38:37.529411+0000","last_fullsized":"2023-07-29T16:38:37.529411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530700+0000","last_change":"2023-07-29T16:37:53.952312+0000","last_active":"2023-07-29T16:38:37.530700+0000","last_peered":"2023-07-29T16:38:37.530700+0000","last_clean":"2023-07-29T16:38:37.530700+0000","last_became_active":"2023-07-29T16:37:53.951032+0000","last_became_peered":"2023-07-29T16:37:53.951032+0000","last_unstale":"2023-07-29T16:38:37.530700+0000","last_undegraded":"2023-07-29T16:38:37.530700+0000","last_fullsized":"2023-07-29T16:38:37.530700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527352+0000","last_change":"2023-07-29T16:37:53.959834+0000","last_active":"2023-07-29T16:38:37.527352+0000","last_peered":"2023-07-29T16:38:37.527352+0000","last_clean":"2023-07-29T16:38:37.527352+0000","last_became_active":"2023-07-29T16:37:53.959535+0000","last_became_peered":"2023-07-29T16:37:53.959535+0000","last_unstale":"2023-07-29T16:38:37.527352+0000","last_undegraded":"2023-07-29T16:38:37.527352+0000","last_fullsized":"2023-07-29T16:38:37.527352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:10:50.447897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530313+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:38:37.530313+0000","last_peered":"2023-07-29T16:38:37.530313+0000","last_clean":"2023-07-29T16:38:37.530313+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:38:37.530313+0000","last_undegraded":"2023-07-29T16:38:37.530313+0000","last_fullsized":"2023-07-29T16:38:37.530313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530575+0000","last_change":"2023-07-29T16:37:53.952052+0000","last_active":"2023-07-29T16:38:37.530575+0000","last_peered":"2023-07-29T16:38:37.530575+0000","last_clean":"2023-07-29T16:38:37.530575+0000","last_became_active":"2023-07-29T16:37:53.951068+0000","last_became_peered":"2023-07-29T16:37:53.951068+0000","last_unstale":"2023-07-29T16:38:37.530575+0000","last_undegraded":"2023-07-29T16:38:37.530575+0000","last_fullsized":"2023-07-29T16:38:37.530575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526910+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:38:37.526910+0000","last_peered":"2023-07-29T16:38:37.526910+0000","last_clean":"2023-07-29T16:38:37.526910+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:38:37.526910+0000","last_undegraded":"2023-07-29T16:38:37.526910+0000","last_fullsized":"2023-07-29T16:38:37.526910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527254+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:38:37.527254+0000","last_peered":"2023-07-29T16:38:37.527254+0000","last_clean":"2023-07-29T16:38:37.527254+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:38:37.527254+0000","last_undegraded":"2023-07-29T16:38:37.527254+0000","last_fullsized":"2023-07-29T16:38:37.527254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526040+0000","last_change":"2023-07-29T16:37:53.957460+0000","last_active":"2023-07-29T16:38:37.526040+0000","last_peered":"2023-07-29T16:38:37.526040+0000","last_clean":"2023-07-29T16:38:37.526040+0000","last_became_active":"2023-07-29T16:37:53.957118+0000","last_became_peered":"2023-07-29T16:37:53.957118+0000","last_unstale":"2023-07-29T16:38:37.526040+0000","last_undegraded":"2023-07-29T16:38:37.526040+0000","last_fullsized":"2023-07-29T16:38:37.526040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529466+0000","last_change":"2023-07-29T16:37:53.957510+0000","last_active":"2023-07-29T16:38:37.529466+0000","last_peered":"2023-07-29T16:38:37.529466+0000","last_clean":"2023-07-29T16:38:37.529466+0000","last_became_active":"2023-07-29T16:37:53.956998+0000","last_became_peered":"2023-07-29T16:37:53.956998+0000","last_unstale":"2023-07-29T16:38:37.529466+0000","last_undegraded":"2023-07-29T16:38:37.529466+0000","last_fullsized":"2023-07-29T16:38:37.529466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530632+0000","last_change":"2023-07-29T16:37:53.951946+0000","last_active":"2023-07-29T16:38:37.530632+0000","last_peered":"2023-07-29T16:38:37.530632+0000","last_clean":"2023-07-29T16:38:37.530632+0000","last_became_active":"2023-07-29T16:37:53.951085+0000","last_became_peered":"2023-07-29T16:37:53.951085+0000","last_unstale":"2023-07-29T16:38:37.530632+0000","last_undegraded":"2023-07-29T16:38:37.530632+0000","last_fullsized":"2023-07-29T16:38:37.530632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529240+0000","last_change":"2023-07-29T16:37:53.951468+0000","last_active":"2023-07-29T16:38:37.529240+0000","last_peered":"2023-07-29T16:38:37.529240+0000","last_clean":"2023-07-29T16:38:37.529240+0000","last_became_active":"2023-07-29T16:37:53.951155+0000","last_became_peered":"2023-07-29T16:37:53.951155+0000","last_unstale":"2023-07-29T16:38:37.529240+0000","last_undegraded":"2023-07-29T16:38:37.529240+0000","last_fullsized":"2023-07-29T16:38:37.529240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527282+0000","last_change":"2023-07-29T16:37:53.957425+0000","last_active":"2023-07-29T16:38:37.527282+0000","last_peered":"2023-07-29T16:38:37.527282+0000","last_clean":"2023-07-29T16:38:37.527282+0000","last_became_active":"2023-07-29T16:37:53.956793+0000","last_became_peered":"2023-07-29T16:37:53.956793+0000","last_unstale":"2023-07-29T16:38:37.527282+0000","last_undegraded":"2023-07-29T16:38:37.527282+0000","last_fullsized":"2023-07-29T16:38:37.527282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527243+0000","last_change":"2023-07-29T16:37:53.957028+0000","last_active":"2023-07-29T16:38:37.527243+0000","last_peered":"2023-07-29T16:38:37.527243+0000","last_clean":"2023-07-29T16:38:37.527243+0000","last_became_active":"2023-07-29T16:37:53.955903+0000","last_became_peered":"2023-07-29T16:37:53.955903+0000","last_unstale":"2023-07-29T16:38:37.527243+0000","last_undegraded":"2023-07-29T16:38:37.527243+0000","last_fullsized":"2023-07-29T16:38:37.527243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530838+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:38:37.530838+0000","last_peered":"2023-07-29T16:38:37.530838+0000","last_clean":"2023-07-29T16:38:37.530838+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:38:37.530838+0000","last_undegraded":"2023-07-29T16:38:37.530838+0000","last_fullsized":"2023-07-29T16:38:37.530838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528594+0000","last_change":"2023-07-29T16:37:53.954822+0000","last_active":"2023-07-29T16:38:37.528594+0000","last_peered":"2023-07-29T16:38:37.528594+0000","last_clean":"2023-07-29T16:38:37.528594+0000","last_became_active":"2023-07-29T16:37:53.954437+0000","last_became_peered":"2023-07-29T16:37:53.954437+0000","last_unstale":"2023-07-29T16:38:37.528594+0000","last_undegraded":"2023-07-29T16:38:37.528594+0000","last_fullsized":"2023-07-29T16:38:37.528594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530065+0000","last_change":"2023-07-29T16:37:53.958324+0000","last_active":"2023-07-29T16:38:37.530065+0000","last_peered":"2023-07-29T16:38:37.530065+0000","last_clean":"2023-07-29T16:38:37.530065+0000","last_became_active":"2023-07-29T16:37:53.957328+0000","last_became_peered":"2023-07-29T16:37:53.957328+0000","last_unstale":"2023-07-29T16:38:37.530065+0000","last_undegraded":"2023-07-29T16:38:37.530065+0000","last_fullsized":"2023-07-29T16:38:37.530065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.531188+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:38:37.531188+0000","last_peered":"2023-07-29T16:38:37.531188+0000","last_clean":"2023-07-29T16:38:37.531188+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:38:37.531188+0000","last_undegraded":"2023-07-29T16:38:37.531188+0000","last_fullsized":"2023-07-29T16:38:37.531188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529410+0000","last_change":"2023-07-29T16:37:53.955816+0000","last_active":"2023-07-29T16:38:37.529410+0000","last_peered":"2023-07-29T16:38:37.529410+0000","last_clean":"2023-07-29T16:38:37.529410+0000","last_became_active":"2023-07-29T16:37:53.955431+0000","last_became_peered":"2023-07-29T16:37:53.955431+0000","last_unstale":"2023-07-29T16:38:37.529410+0000","last_undegraded":"2023-07-29T16:38:37.529410+0000","last_fullsized":"2023-07-29T16:38:37.529410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527599+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:38:37.527599+0000","last_peered":"2023-07-29T16:38:37.527599+0000","last_clean":"2023-07-29T16:38:37.527599+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:38:37.527599+0000","last_undegraded":"2023-07-29T16:38:37.527599+0000","last_fullsized":"2023-07-29T16:38:37.527599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530554+0000","last_change":"2023-07-29T16:37:53.565382+0000","last_active":"2023-07-29T16:38:37.530554+0000","last_peered":"2023-07-29T16:38:37.530554+0000","last_clean":"2023-07-29T16:38:37.530554+0000","last_became_active":"2023-07-29T16:37:53.564431+0000","last_became_peered":"2023-07-29T16:37:53.564431+0000","last_unstale":"2023-07-29T16:38:37.530554+0000","last_undegraded":"2023-07-29T16:38:37.530554+0000","last_fullsized":"2023-07-29T16:38:37.530554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:48:43.905018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530565+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:38:37.530565+0000","last_peered":"2023-07-29T16:38:37.530565+0000","last_clean":"2023-07-29T16:38:37.530565+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:38:37.530565+0000","last_undegraded":"2023-07-29T16:38:37.530565+0000","last_fullsized":"2023-07-29T16:38:37.530565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528673+0000","last_change":"2023-07-29T16:37:53.571983+0000","last_active":"2023-07-29T16:38:37.528673+0000","last_peered":"2023-07-29T16:38:37.528673+0000","last_clean":"2023-07-29T16:38:37.528673+0000","last_became_active":"2023-07-29T16:37:53.571637+0000","last_became_peered":"2023-07-29T16:37:53.571637+0000","last_unstale":"2023-07-29T16:38:37.528673+0000","last_undegraded":"2023-07-29T16:38:37.528673+0000","last_fullsized":"2023-07-29T16:38:37.528673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529488+0000","last_change":"2023-07-29T16:37:53.955208+0000","last_active":"2023-07-29T16:38:37.529488+0000","last_peered":"2023-07-29T16:38:37.529488+0000","last_clean":"2023-07-29T16:38:37.529488+0000","last_became_active":"2023-07-29T16:37:53.954457+0000","last_became_peered":"2023-07-29T16:37:53.954457+0000","last_unstale":"2023-07-29T16:38:37.529488+0000","last_undegraded":"2023-07-29T16:38:37.529488+0000","last_fullsized":"2023-07-29T16:38:37.529488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528714+0000","last_change":"2023-07-29T16:37:53.566694+0000","last_active":"2023-07-29T16:38:37.528714+0000","last_peered":"2023-07-29T16:38:37.528714+0000","last_clean":"2023-07-29T16:38:37.528714+0000","last_became_active":"2023-07-29T16:37:53.566446+0000","last_became_peered":"2023-07-29T16:37:53.566446+0000","last_unstale":"2023-07-29T16:38:37.528714+0000","last_undegraded":"2023-07-29T16:38:37.528714+0000","last_fullsized":"2023-07-29T16:38:37.528714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.531170+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:38:37.531170+0000","last_peered":"2023-07-29T16:38:37.531170+0000","last_clean":"2023-07-29T16:38:37.531170+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:38:37.531170+0000","last_undegraded":"2023-07-29T16:38:37.531170+0000","last_fullsized":"2023-07-29T16:38:37.531170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529571+0000","last_change":"2023-07-29T16:37:53.571850+0000","last_active":"2023-07-29T16:38:37.529571+0000","last_peered":"2023-07-29T16:38:37.529571+0000","last_clean":"2023-07-29T16:38:37.529571+0000","last_became_active":"2023-07-29T16:37:53.571589+0000","last_became_peered":"2023-07-29T16:37:53.571589+0000","last_unstale":"2023-07-29T16:38:37.529571+0000","last_undegraded":"2023-07-29T16:38:37.529571+0000","last_fullsized":"2023-07-29T16:38:37.529571+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528758+0000","last_change":"2023-07-29T16:37:53.957334+0000","last_active":"2023-07-29T16:38:37.528758+0000","last_peered":"2023-07-29T16:38:37.528758+0000","last_clean":"2023-07-29T16:38:37.528758+0000","last_became_active":"2023-07-29T16:37:53.956958+0000","last_became_peered":"2023-07-29T16:37:53.956958+0000","last_unstale":"2023-07-29T16:38:37.528758+0000","last_undegraded":"2023-07-29T16:38:37.528758+0000","last_fullsized":"2023-07-29T16:38:37.528758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527564+0000","last_change":"2023-07-29T16:37:53.566389+0000","last_active":"2023-07-29T16:38:37.527564+0000","last_peered":"2023-07-29T16:38:37.527564+0000","last_clean":"2023-07-29T16:38:37.527564+0000","last_became_active":"2023-07-29T16:37:53.565061+0000","last_became_peered":"2023-07-29T16:37:53.565061+0000","last_unstale":"2023-07-29T16:38:37.527564+0000","last_undegraded":"2023-07-29T16:38:37.527564+0000","last_fullsized":"2023-07-29T16:38:37.527564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:00:24.687105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530011+0000","last_change":"2023-07-29T16:37:53.955198+0000","last_active":"2023-07-29T16:38:37.530011+0000","last_peered":"2023-07-29T16:38:37.530011+0000","last_clean":"2023-07-29T16:38:37.530011+0000","last_became_active":"2023-07-29T16:37:53.954587+0000","last_became_peered":"2023-07-29T16:37:53.954587+0000","last_unstale":"2023-07-29T16:38:37.530011+0000","last_undegraded":"2023-07-29T16:38:37.530011+0000","last_fullsized":"2023-07-29T16:38:37.530011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530698+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:38:37.530698+0000","last_peered":"2023-07-29T16:38:37.530698+0000","last_clean":"2023-07-29T16:38:37.530698+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:38:37.530698+0000","last_undegraded":"2023-07-29T16:38:37.530698+0000","last_fullsized":"2023-07-29T16:38:37.530698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528647+0000","last_change":"2023-07-29T16:37:53.957960+0000","last_active":"2023-07-29T16:38:37.528647+0000","last_peered":"2023-07-29T16:38:37.528647+0000","last_clean":"2023-07-29T16:38:37.528647+0000","last_became_active":"2023-07-29T16:37:53.957385+0000","last_became_peered":"2023-07-29T16:37:53.957385+0000","last_unstale":"2023-07-29T16:38:37.528647+0000","last_undegraded":"2023-07-29T16:38:37.528647+0000","last_fullsized":"2023-07-29T16:38:37.528647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527195+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:38:37.527195+0000","last_peered":"2023-07-29T16:38:37.527195+0000","last_clean":"2023-07-29T16:38:37.527195+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:38:37.527195+0000","last_undegraded":"2023-07-29T16:38:37.527195+0000","last_fullsized":"2023-07-29T16:38:37.527195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527058+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:38:37.527058+0000","last_peered":"2023-07-29T16:38:37.527058+0000","last_clean":"2023-07-29T16:38:37.527058+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:38:37.527058+0000","last_undegraded":"2023-07-29T16:38:37.527058+0000","last_fullsized":"2023-07-29T16:38:37.527058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526954+0000","last_change":"2023-07-29T16:37:53.569255+0000","last_active":"2023-07-29T16:38:37.526954+0000","last_peered":"2023-07-29T16:38:37.526954+0000","last_clean":"2023-07-29T16:38:37.526954+0000","last_became_active":"2023-07-29T16:37:53.568873+0000","last_became_peered":"2023-07-29T16:37:53.568873+0000","last_unstale":"2023-07-29T16:38:37.526954+0000","last_undegraded":"2023-07-29T16:38:37.526954+0000","last_fullsized":"2023-07-29T16:38:37.526954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:16:32.797557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530480+0000","last_change":"2023-07-29T16:37:53.959213+0000","last_active":"2023-07-29T16:38:37.530480+0000","last_peered":"2023-07-29T16:38:37.530480+0000","last_clean":"2023-07-29T16:38:37.530480+0000","last_became_active":"2023-07-29T16:37:53.958325+0000","last_became_peered":"2023-07-29T16:37:53.958325+0000","last_unstale":"2023-07-29T16:38:37.530480+0000","last_undegraded":"2023-07-29T16:38:37.530480+0000","last_fullsized":"2023-07-29T16:38:37.530480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528743+0000","last_change":"2023-07-29T16:37:53.571133+0000","last_active":"2023-07-29T16:38:37.528743+0000","last_peered":"2023-07-29T16:38:37.528743+0000","last_clean":"2023-07-29T16:38:37.528743+0000","last_became_active":"2023-07-29T16:37:53.570852+0000","last_became_peered":"2023-07-29T16:37:53.570852+0000","last_unstale":"2023-07-29T16:38:37.528743+0000","last_undegraded":"2023-07-29T16:38:37.528743+0000","last_fullsized":"2023-07-29T16:38:37.528743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530683+0000","last_change":"2023-07-29T16:37:53.959791+0000","last_active":"2023-07-29T16:38:37.530683+0000","last_peered":"2023-07-29T16:38:37.530683+0000","last_clean":"2023-07-29T16:38:37.530683+0000","last_became_active":"2023-07-29T16:37:53.958992+0000","last_became_peered":"2023-07-29T16:37:53.958992+0000","last_unstale":"2023-07-29T16:38:37.530683+0000","last_undegraded":"2023-07-29T16:38:37.530683+0000","last_fullsized":"2023-07-29T16:38:37.530683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:24:33.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530130+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:38:37.530130+0000","last_peered":"2023-07-29T16:38:37.530130+0000","last_clean":"2023-07-29T16:38:37.530130+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:38:37.530130+0000","last_undegraded":"2023-07-29T16:38:37.530130+0000","last_fullsized":"2023-07-29T16:38:37.530130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529476+0000","last_change":"2023-07-29T16:37:53.955817+0000","last_active":"2023-07-29T16:38:37.529476+0000","last_peered":"2023-07-29T16:38:37.529476+0000","last_clean":"2023-07-29T16:38:37.529476+0000","last_became_active":"2023-07-29T16:37:53.955481+0000","last_became_peered":"2023-07-29T16:37:53.955481+0000","last_unstale":"2023-07-29T16:38:37.529476+0000","last_undegraded":"2023-07-29T16:38:37.529476+0000","last_fullsized":"2023-07-29T16:38:37.529476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:45:44.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.525987+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:38:37.525987+0000","last_peered":"2023-07-29T16:38:37.525987+0000","last_clean":"2023-07-29T16:38:37.525987+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:38:37.525987+0000","last_undegraded":"2023-07-29T16:38:37.525987+0000","last_fullsized":"2023-07-29T16:38:37.525987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529666+0000","last_change":"2023-07-29T16:37:53.955866+0000","last_active":"2023-07-29T16:38:37.529666+0000","last_peered":"2023-07-29T16:38:37.529666+0000","last_clean":"2023-07-29T16:38:37.529666+0000","last_became_active":"2023-07-29T16:37:53.955245+0000","last_became_peered":"2023-07-29T16:37:53.955245+0000","last_unstale":"2023-07-29T16:38:37.529666+0000","last_undegraded":"2023-07-29T16:38:37.529666+0000","last_fullsized":"2023-07-29T16:38:37.529666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:49.025478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"35'4097","reported_seq":4121,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.524850+0000","last_change":"2023-07-29T16:38:15.000885+0000","last_active":"2023-07-29T16:38:40.524850+0000","last_peered":"2023-07-29T16:38:40.524850+0000","last_clean":"2023-07-29T16:38:40.524850+0000","last_became_active":"2023-07-29T16:38:15.000700+0000","last_became_peered":"2023-07-29T16:38:15.000700+0000","last_unstale":"2023-07-29T16:38:40.524850+0000","last_undegraded":"2023-07-29T16:38:40.524850+0000","last_fullsized":"2023-07-29T16:38:40.524850+0000","mapping_epoch":19,"log_start":"22'300","ondisk_log_start":"22'300","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:28.796109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268500992,"num_objects":4097,"num_object_clones":0,"num_object_copies":8194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4097,"num_write_kb":262208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528666+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:38:37.528666+0000","last_peered":"2023-07-29T16:38:37.528666+0000","last_clean":"2023-07-29T16:38:37.528666+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:38:37.528666+0000","last_undegraded":"2023-07-29T16:38:37.528666+0000","last_fullsized":"2023-07-29T16:38:37.528666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530316+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:38:37.530316+0000","last_peered":"2023-07-29T16:38:37.530316+0000","last_clean":"2023-07-29T16:38:37.530316+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:38:37.530316+0000","last_undegraded":"2023-07-29T16:38:37.530316+0000","last_fullsized":"2023-07-29T16:38:37.530316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"35'4088","reported_seq":4112,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.512632+0000","last_change":"2023-07-29T16:38:15.002940+0000","last_active":"2023-07-29T16:38:40.512632+0000","last_peered":"2023-07-29T16:38:40.512632+0000","last_clean":"2023-07-29T16:38:40.512632+0000","last_became_active":"2023-07-29T16:38:15.002741+0000","last_became_peered":"2023-07-29T16:38:15.002741+0000","last_unstale":"2023-07-29T16:38:40.512632+0000","last_undegraded":"2023-07-29T16:38:40.512632+0000","last_fullsized":"2023-07-29T16:38:40.512632+0000","mapping_epoch":19,"log_start":"21'100","ondisk_log_start":"21'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267911168,"num_objects":4088,"num_object_clones":0,"num_object_copies":8176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4088,"num_write_kb":261632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530523+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:38:37.530523+0000","last_peered":"2023-07-29T16:38:37.530523+0000","last_clean":"2023-07-29T16:38:37.530523+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:38:37.530523+0000","last_undegraded":"2023-07-29T16:38:37.530523+0000","last_fullsized":"2023-07-29T16:38:37.530523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530348+0000","last_change":"2023-07-29T16:37:53.951333+0000","last_active":"2023-07-29T16:38:37.530348+0000","last_peered":"2023-07-29T16:38:37.530348+0000","last_clean":"2023-07-29T16:38:37.530348+0000","last_became_active":"2023-07-29T16:37:53.950564+0000","last_became_peered":"2023-07-29T16:37:53.950564+0000","last_unstale":"2023-07-29T16:38:37.530348+0000","last_undegraded":"2023-07-29T16:38:37.530348+0000","last_fullsized":"2023-07-29T16:38:37.530348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"35'4098","reported_seq":4122,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.520916+0000","last_change":"2023-07-29T16:38:15.002847+0000","last_active":"2023-07-29T16:38:40.520916+0000","last_peered":"2023-07-29T16:38:40.520916+0000","last_clean":"2023-07-29T16:38:40.520916+0000","last_became_active":"2023-07-29T16:38:15.002520+0000","last_became_peered":"2023-07-29T16:38:15.002520+0000","last_unstale":"2023-07-29T16:38:40.520916+0000","last_undegraded":"2023-07-29T16:38:40.520916+0000","last_fullsized":"2023-07-29T16:38:40.520916+0000","mapping_epoch":19,"log_start":"21'100","ondisk_log_start":"21'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3998,"log_dups_size":0,"ondisk_log_size":3998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268566528,"num_objects":4098,"num_object_clones":0,"num_object_copies":8196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4098,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4098,"num_write_kb":262272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527264+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:38:37.527264+0000","last_peered":"2023-07-29T16:38:37.527264+0000","last_clean":"2023-07-29T16:38:37.527264+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:38:37.527264+0000","last_undegraded":"2023-07-29T16:38:37.527264+0000","last_fullsized":"2023-07-29T16:38:37.527264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527159+0000","last_change":"2023-07-29T16:37:53.960209+0000","last_active":"2023-07-29T16:38:37.527159+0000","last_peered":"2023-07-29T16:38:37.527159+0000","last_clean":"2023-07-29T16:38:37.527159+0000","last_became_active":"2023-07-29T16:37:53.959700+0000","last_became_peered":"2023-07-29T16:37:53.959700+0000","last_unstale":"2023-07-29T16:38:37.527159+0000","last_undegraded":"2023-07-29T16:38:37.527159+0000","last_fullsized":"2023-07-29T16:38:37.527159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:18:34.438728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"35'4000","reported_seq":4024,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.514295+0000","last_change":"2023-07-29T16:38:15.003542+0000","last_active":"2023-07-29T16:38:40.514295+0000","last_peered":"2023-07-29T16:38:40.514295+0000","last_clean":"2023-07-29T16:38:40.514295+0000","last_became_active":"2023-07-29T16:38:15.003374+0000","last_became_peered":"2023-07-29T16:38:15.003374+0000","last_unstale":"2023-07-29T16:38:40.514295+0000","last_undegraded":"2023-07-29T16:38:40.514295+0000","last_fullsized":"2023-07-29T16:38:40.514295+0000","mapping_epoch":19,"log_start":"22'400","ondisk_log_start":"22'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:17:50.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144000,"num_objects":4000,"num_object_clones":0,"num_object_copies":8000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4000,"num_write_kb":256000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:38.523399+0000","last_change":"2023-07-29T16:38:37.532304+0000","last_active":"2023-07-29T16:38:38.523399+0000","last_peered":"2023-07-29T16:38:38.523399+0000","last_clean":"2023-07-29T16:38:38.523399+0000","last_became_active":"2023-07-29T16:38:37.532109+0000","last_became_peered":"2023-07-29T16:38:37.532109+0000","last_unstale":"2023-07-29T16:38:38.523399+0000","last_undegraded":"2023-07-29T16:38:38.523399+0000","last_fullsized":"2023-07-29T16:38:38.523399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:14:11.168356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528857+0000","last_change":"2023-07-29T16:37:53.955439+0000","last_active":"2023-07-29T16:38:37.528857+0000","last_peered":"2023-07-29T16:38:37.528857+0000","last_clean":"2023-07-29T16:38:37.528857+0000","last_became_active":"2023-07-29T16:37:53.955054+0000","last_became_peered":"2023-07-29T16:37:53.955054+0000","last_unstale":"2023-07-29T16:38:37.528857+0000","last_undegraded":"2023-07-29T16:38:37.528857+0000","last_fullsized":"2023-07-29T16:38:37.528857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:57.365599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"35'4068","reported_seq":4092,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.505115+0000","last_change":"2023-07-29T16:38:15.000783+0000","last_active":"2023-07-29T16:38:40.505115+0000","last_peered":"2023-07-29T16:38:40.505115+0000","last_clean":"2023-07-29T16:38:40.505115+0000","last_became_active":"2023-07-29T16:38:15.000526+0000","last_became_peered":"2023-07-29T16:38:15.000526+0000","last_unstale":"2023-07-29T16:38:40.505115+0000","last_undegraded":"2023-07-29T16:38:40.505115+0000","last_fullsized":"2023-07-29T16:38:40.505115+0000","mapping_epoch":19,"log_start":"21'100","ondisk_log_start":"21'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:37.626808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266600448,"num_objects":4068,"num_object_clones":0,"num_object_copies":8136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4068,"num_write_kb":260352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528728+0000","last_change":"2023-07-29T16:37:53.571080+0000","last_active":"2023-07-29T16:38:37.528728+0000","last_peered":"2023-07-29T16:38:37.528728+0000","last_clean":"2023-07-29T16:38:37.528728+0000","last_became_active":"2023-07-29T16:37:53.570772+0000","last_became_peered":"2023-07-29T16:37:53.570772+0000","last_unstale":"2023-07-29T16:38:37.528728+0000","last_undegraded":"2023-07-29T16:38:37.528728+0000","last_fullsized":"2023-07-29T16:38:37.528728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526923+0000","last_change":"2023-07-29T16:37:53.957921+0000","last_active":"2023-07-29T16:38:37.526923+0000","last_peered":"2023-07-29T16:38:37.526923+0000","last_clean":"2023-07-29T16:38:37.526923+0000","last_became_active":"2023-07-29T16:37:53.957208+0000","last_became_peered":"2023-07-29T16:37:53.957208+0000","last_unstale":"2023-07-29T16:38:37.526923+0000","last_undegraded":"2023-07-29T16:38:37.526923+0000","last_fullsized":"2023-07-29T16:38:37.526923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"35'4148","reported_seq":4172,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.529091+0000","last_change":"2023-07-29T16:38:15.002770+0000","last_active":"2023-07-29T16:38:40.529091+0000","last_peered":"2023-07-29T16:38:40.529091+0000","last_clean":"2023-07-29T16:38:40.529091+0000","last_became_active":"2023-07-29T16:38:15.002365+0000","last_became_peered":"2023-07-29T16:38:15.002365+0000","last_unstale":"2023-07-29T16:38:40.529091+0000","last_undegraded":"2023-07-29T16:38:40.529091+0000","last_fullsized":"2023-07-29T16:38:40.529091+0000","mapping_epoch":19,"log_start":"22'600","ondisk_log_start":"22'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3548,"log_dups_size":0,"ondisk_log_size":3548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:31:33.326032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271843328,"num_objects":4148,"num_object_clones":0,"num_object_copies":8296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4148,"num_write_kb":265472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526735+0000","last_change":"2023-07-29T16:37:53.568931+0000","last_active":"2023-07-29T16:38:37.526735+0000","last_peered":"2023-07-29T16:38:37.526735+0000","last_clean":"2023-07-29T16:38:37.526735+0000","last_became_active":"2023-07-29T16:37:53.567185+0000","last_became_peered":"2023-07-29T16:37:53.567185+0000","last_unstale":"2023-07-29T16:38:37.526735+0000","last_undegraded":"2023-07-29T16:38:37.526735+0000","last_fullsized":"2023-07-29T16:38:37.526735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:42:31.656024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527634+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:38:37.527634+0000","last_peered":"2023-07-29T16:38:37.527634+0000","last_clean":"2023-07-29T16:38:37.527634+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:38:37.527634+0000","last_undegraded":"2023-07-29T16:38:37.527634+0000","last_fullsized":"2023-07-29T16:38:37.527634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"35'4088","reported_seq":4112,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.522611+0000","last_change":"2023-07-29T16:38:15.000922+0000","last_active":"2023-07-29T16:38:40.522611+0000","last_peered":"2023-07-29T16:38:40.522611+0000","last_clean":"2023-07-29T16:38:40.522611+0000","last_became_active":"2023-07-29T16:38:15.000713+0000","last_became_peered":"2023-07-29T16:38:15.000713+0000","last_unstale":"2023-07-29T16:38:40.522611+0000","last_undegraded":"2023-07-29T16:38:40.522611+0000","last_fullsized":"2023-07-29T16:38:40.522611+0000","mapping_epoch":19,"log_start":"22'300","ondisk_log_start":"22'300","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3788,"log_dups_size":0,"ondisk_log_size":3788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:47:48.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267911168,"num_objects":4088,"num_object_clones":0,"num_object_copies":8176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4088,"num_write_kb":261632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530070+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:38:37.530070+0000","last_peered":"2023-07-29T16:38:37.530070+0000","last_clean":"2023-07-29T16:38:37.530070+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:38:37.530070+0000","last_undegraded":"2023-07-29T16:38:37.530070+0000","last_fullsized":"2023-07-29T16:38:37.530070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527641+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:38:37.527641+0000","last_peered":"2023-07-29T16:38:37.527641+0000","last_clean":"2023-07-29T16:38:37.527641+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:38:37.527641+0000","last_undegraded":"2023-07-29T16:38:37.527641+0000","last_fullsized":"2023-07-29T16:38:37.527641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'3996","reported_seq":4020,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.525197+0000","last_change":"2023-07-29T16:38:15.002931+0000","last_active":"2023-07-29T16:38:40.525197+0000","last_peered":"2023-07-29T16:38:40.525197+0000","last_clean":"2023-07-29T16:38:40.525197+0000","last_became_active":"2023-07-29T16:38:15.002633+0000","last_became_peered":"2023-07-29T16:38:15.002633+0000","last_unstale":"2023-07-29T16:38:40.525197+0000","last_undegraded":"2023-07-29T16:38:40.525197+0000","last_fullsized":"2023-07-29T16:38:40.525197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:28.941722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261881856,"num_objects":3996,"num_object_clones":0,"num_object_copies":7992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3996,"num_write_kb":255744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530210+0000","last_change":"2023-07-29T16:37:53.565044+0000","last_active":"2023-07-29T16:38:37.530210+0000","last_peered":"2023-07-29T16:38:37.530210+0000","last_clean":"2023-07-29T16:38:37.530210+0000","last_became_active":"2023-07-29T16:37:53.564490+0000","last_became_peered":"2023-07-29T16:37:53.564490+0000","last_unstale":"2023-07-29T16:38:37.530210+0000","last_undegraded":"2023-07-29T16:38:37.530210+0000","last_fullsized":"2023-07-29T16:38:37.530210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529523+0000","last_change":"2023-07-29T16:37:53.959465+0000","last_active":"2023-07-29T16:38:37.529523+0000","last_peered":"2023-07-29T16:38:37.529523+0000","last_clean":"2023-07-29T16:38:37.529523+0000","last_became_active":"2023-07-29T16:37:53.958435+0000","last_became_peered":"2023-07-29T16:37:53.958435+0000","last_unstale":"2023-07-29T16:38:37.529523+0000","last_undegraded":"2023-07-29T16:38:37.529523+0000","last_fullsized":"2023-07-29T16:38:37.529523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"35'4076","reported_seq":4100,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.514886+0000","last_change":"2023-07-29T16:38:15.002651+0000","last_active":"2023-07-29T16:38:40.514886+0000","last_peered":"2023-07-29T16:38:40.514886+0000","last_clean":"2023-07-29T16:38:40.514886+0000","last_became_active":"2023-07-29T16:38:15.002346+0000","last_became_peered":"2023-07-29T16:38:15.002346+0000","last_unstale":"2023-07-29T16:38:40.514886+0000","last_undegraded":"2023-07-29T16:38:40.514886+0000","last_fullsized":"2023-07-29T16:38:40.514886+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:26:01.849953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267124736,"num_objects":4076,"num_object_clones":0,"num_object_copies":8152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4076,"num_write_kb":260864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529285+0000","last_change":"2023-07-29T16:37:48.539850+0000","last_active":"2023-07-29T16:38:37.529285+0000","last_peered":"2023-07-29T16:38:37.529285+0000","last_clean":"2023-07-29T16:38:37.529285+0000","last_became_active":"2023-07-29T16:37:48.539506+0000","last_became_peered":"2023-07-29T16:37:48.539506+0000","last_unstale":"2023-07-29T16:38:37.529285+0000","last_undegraded":"2023-07-29T16:38:37.529285+0000","last_fullsized":"2023-07-29T16:38:37.529285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:38:50.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527499+0000","last_change":"2023-07-29T16:37:53.565670+0000","last_active":"2023-07-29T16:38:37.527499+0000","last_peered":"2023-07-29T16:38:37.527499+0000","last_clean":"2023-07-29T16:38:37.527499+0000","last_became_active":"2023-07-29T16:37:53.563733+0000","last_became_peered":"2023-07-29T16:37:53.563733+0000","last_unstale":"2023-07-29T16:38:37.527499+0000","last_undegraded":"2023-07-29T16:38:37.527499+0000","last_fullsized":"2023-07-29T16:38:37.527499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:03:44.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530709+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:38:37.530709+0000","last_peered":"2023-07-29T16:38:37.530709+0000","last_clean":"2023-07-29T16:38:37.530709+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:38:37.530709+0000","last_undegraded":"2023-07-29T16:38:37.530709+0000","last_fullsized":"2023-07-29T16:38:37.530709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"35'4079","reported_seq":4103,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.509697+0000","last_change":"2023-07-29T16:38:15.002643+0000","last_active":"2023-07-29T16:38:40.509697+0000","last_peered":"2023-07-29T16:38:40.509697+0000","last_clean":"2023-07-29T16:38:40.509697+0000","last_became_active":"2023-07-29T16:38:15.002395+0000","last_became_peered":"2023-07-29T16:38:15.002395+0000","last_unstale":"2023-07-29T16:38:40.509697+0000","last_undegraded":"2023-07-29T16:38:40.509697+0000","last_fullsized":"2023-07-29T16:38:40.509697+0000","mapping_epoch":19,"log_start":"22'500","ondisk_log_start":"22'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:07:10.753410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267321344,"num_objects":4079,"num_object_clones":0,"num_object_copies":8158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4079,"num_write_kb":261056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526821+0000","last_change":"2023-07-29T16:37:48.537993+0000","last_active":"2023-07-29T16:38:37.526821+0000","last_peered":"2023-07-29T16:38:37.526821+0000","last_clean":"2023-07-29T16:38:37.526821+0000","last_became_active":"2023-07-29T16:37:48.537652+0000","last_became_peered":"2023-07-29T16:37:48.537652+0000","last_unstale":"2023-07-29T16:38:37.526821+0000","last_undegraded":"2023-07-29T16:38:37.526821+0000","last_fullsized":"2023-07-29T16:38:37.526821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:41:07.585724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526869+0000","last_change":"2023-07-29T16:37:53.568945+0000","last_active":"2023-07-29T16:38:37.526869+0000","last_peered":"2023-07-29T16:38:37.526869+0000","last_clean":"2023-07-29T16:38:37.526869+0000","last_became_active":"2023-07-29T16:37:53.567072+0000","last_became_peered":"2023-07-29T16:37:53.567072+0000","last_unstale":"2023-07-29T16:38:37.526869+0000","last_undegraded":"2023-07-29T16:38:37.526869+0000","last_fullsized":"2023-07-29T16:38:37.526869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:29:14.372472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529210+0000","last_change":"2023-07-29T16:37:53.957078+0000","last_active":"2023-07-29T16:38:37.529210+0000","last_peered":"2023-07-29T16:38:37.529210+0000","last_clean":"2023-07-29T16:38:37.529210+0000","last_became_active":"2023-07-29T16:37:53.956814+0000","last_became_peered":"2023-07-29T16:37:53.956814+0000","last_unstale":"2023-07-29T16:38:37.529210+0000","last_undegraded":"2023-07-29T16:38:37.529210+0000","last_fullsized":"2023-07-29T16:38:37.529210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:46:17.656830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"35'3980","reported_seq":4003,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.529522+0000","last_change":"2023-07-29T16:38:15.002654+0000","last_active":"2023-07-29T16:38:40.529522+0000","last_peered":"2023-07-29T16:38:40.529522+0000","last_clean":"2023-07-29T16:38:40.529522+0000","last_became_active":"2023-07-29T16:38:15.002431+0000","last_became_peered":"2023-07-29T16:38:15.002431+0000","last_unstale":"2023-07-29T16:38:40.529522+0000","last_undegraded":"2023-07-29T16:38:40.529522+0000","last_fullsized":"2023-07-29T16:38:40.529522+0000","mapping_epoch":19,"log_start":"22'400","ondisk_log_start":"22'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3580,"log_dups_size":0,"ondisk_log_size":3580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:18.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260833280,"num_objects":3980,"num_object_clones":0,"num_object_copies":7960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3980,"num_write_kb":254720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528515+0000","last_change":"2023-07-29T16:37:48.539852+0000","last_active":"2023-07-29T16:38:37.528515+0000","last_peered":"2023-07-29T16:38:37.528515+0000","last_clean":"2023-07-29T16:38:37.528515+0000","last_became_active":"2023-07-29T16:37:48.539532+0000","last_became_peered":"2023-07-29T16:37:48.539532+0000","last_unstale":"2023-07-29T16:38:37.528515+0000","last_undegraded":"2023-07-29T16:38:37.528515+0000","last_fullsized":"2023-07-29T16:38:37.528515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530183+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:38:37.530183+0000","last_peered":"2023-07-29T16:38:37.530183+0000","last_clean":"2023-07-29T16:38:37.530183+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:38:37.530183+0000","last_undegraded":"2023-07-29T16:38:37.530183+0000","last_fullsized":"2023-07-29T16:38:37.530183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529621+0000","last_change":"2023-07-29T16:37:53.959423+0000","last_active":"2023-07-29T16:38:37.529621+0000","last_peered":"2023-07-29T16:38:37.529621+0000","last_clean":"2023-07-29T16:38:37.529621+0000","last_became_active":"2023-07-29T16:37:53.958272+0000","last_became_peered":"2023-07-29T16:37:53.958272+0000","last_unstale":"2023-07-29T16:38:37.529621+0000","last_undegraded":"2023-07-29T16:38:37.529621+0000","last_fullsized":"2023-07-29T16:38:37.529621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"35'4102","reported_seq":4126,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.503775+0000","last_change":"2023-07-29T16:38:15.002929+0000","last_active":"2023-07-29T16:38:40.503775+0000","last_peered":"2023-07-29T16:38:40.503775+0000","last_clean":"2023-07-29T16:38:40.503775+0000","last_became_active":"2023-07-29T16:38:15.002588+0000","last_became_peered":"2023-07-29T16:38:15.002588+0000","last_unstale":"2023-07-29T16:38:40.503775+0000","last_undegraded":"2023-07-29T16:38:40.503775+0000","last_fullsized":"2023-07-29T16:38:40.503775+0000","mapping_epoch":19,"log_start":"21'100","ondisk_log_start":"21'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:55.768262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268828672,"num_objects":4102,"num_object_clones":0,"num_object_copies":8204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4102,"num_write_kb":262528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526965+0000","last_change":"2023-07-29T16:37:48.537980+0000","last_active":"2023-07-29T16:38:37.526965+0000","last_peered":"2023-07-29T16:38:37.526965+0000","last_clean":"2023-07-29T16:38:37.526965+0000","last_became_active":"2023-07-29T16:37:48.537696+0000","last_became_peered":"2023-07-29T16:37:48.537696+0000","last_unstale":"2023-07-29T16:38:37.526965+0000","last_undegraded":"2023-07-29T16:38:37.526965+0000","last_fullsized":"2023-07-29T16:38:37.526965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:58:16.760014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526071+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:38:37.526071+0000","last_peered":"2023-07-29T16:38:37.526071+0000","last_clean":"2023-07-29T16:38:37.526071+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:38:37.526071+0000","last_undegraded":"2023-07-29T16:38:37.526071+0000","last_fullsized":"2023-07-29T16:38:37.526071+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528567+0000","last_change":"2023-07-29T16:37:53.568331+0000","last_active":"2023-07-29T16:38:37.528567+0000","last_peered":"2023-07-29T16:38:37.528567+0000","last_clean":"2023-07-29T16:38:37.528567+0000","last_became_active":"2023-07-29T16:37:53.567925+0000","last_became_peered":"2023-07-29T16:37:53.567925+0000","last_unstale":"2023-07-29T16:38:37.528567+0000","last_undegraded":"2023-07-29T16:38:37.528567+0000","last_fullsized":"2023-07-29T16:38:37.528567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527502+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:38:37.527502+0000","last_peered":"2023-07-29T16:38:37.527502+0000","last_clean":"2023-07-29T16:38:37.527502+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:38:37.527502+0000","last_undegraded":"2023-07-29T16:38:37.527502+0000","last_fullsized":"2023-07-29T16:38:37.527502+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'4034","reported_seq":4058,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.520610+0000","last_change":"2023-07-29T16:38:15.002704+0000","last_active":"2023-07-29T16:38:40.520610+0000","last_peered":"2023-07-29T16:38:40.520610+0000","last_clean":"2023-07-29T16:38:40.520610+0000","last_became_active":"2023-07-29T16:38:15.002458+0000","last_became_peered":"2023-07-29T16:38:15.002458+0000","last_unstale":"2023-07-29T16:38:40.520610+0000","last_undegraded":"2023-07-29T16:38:40.520610+0000","last_fullsized":"2023-07-29T16:38:40.520610+0000","mapping_epoch":19,"log_start":"22'300","ondisk_log_start":"22'300","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3734,"log_dups_size":0,"ondisk_log_size":3734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:12:05.891647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264372224,"num_objects":4034,"num_object_clones":0,"num_object_copies":8068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4034,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4034,"num_write_kb":258176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.525907+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:38:37.525907+0000","last_peered":"2023-07-29T16:38:37.525907+0000","last_clean":"2023-07-29T16:38:37.525907+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:38:37.525907+0000","last_undegraded":"2023-07-29T16:38:37.525907+0000","last_fullsized":"2023-07-29T16:38:37.525907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528378+0000","last_change":"2023-07-29T16:37:53.571964+0000","last_active":"2023-07-29T16:38:37.528378+0000","last_peered":"2023-07-29T16:38:37.528378+0000","last_clean":"2023-07-29T16:38:37.528378+0000","last_became_active":"2023-07-29T16:37:53.571603+0000","last_became_peered":"2023-07-29T16:37:53.571603+0000","last_unstale":"2023-07-29T16:38:37.528378+0000","last_undegraded":"2023-07-29T16:38:37.528378+0000","last_fullsized":"2023-07-29T16:38:37.528378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530614+0000","last_change":"2023-07-29T16:37:53.953122+0000","last_active":"2023-07-29T16:38:37.530614+0000","last_peered":"2023-07-29T16:38:37.530614+0000","last_clean":"2023-07-29T16:38:37.530614+0000","last_became_active":"2023-07-29T16:37:53.951920+0000","last_became_peered":"2023-07-29T16:37:53.951920+0000","last_unstale":"2023-07-29T16:38:37.530614+0000","last_undegraded":"2023-07-29T16:38:37.530614+0000","last_fullsized":"2023-07-29T16:38:37.530614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:46:10.098363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"35'4093","reported_seq":4115,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.515113+0000","last_change":"2023-07-29T16:38:15.002764+0000","last_active":"2023-07-29T16:38:40.515113+0000","last_peered":"2023-07-29T16:38:40.515113+0000","last_clean":"2023-07-29T16:38:40.515113+0000","last_became_active":"2023-07-29T16:38:15.002492+0000","last_became_peered":"2023-07-29T16:38:15.002492+0000","last_unstale":"2023-07-29T16:38:40.515113+0000","last_undegraded":"2023-07-29T16:38:40.515113+0000","last_fullsized":"2023-07-29T16:38:40.515113+0000","mapping_epoch":19,"log_start":"22'300","ondisk_log_start":"22'300","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268238848,"num_objects":4093,"num_object_clones":0,"num_object_copies":8186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4093,"num_write_kb":261952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530787+0000","last_change":"2023-07-29T16:37:48.538244+0000","last_active":"2023-07-29T16:38:37.530787+0000","last_peered":"2023-07-29T16:38:37.530787+0000","last_clean":"2023-07-29T16:38:37.530787+0000","last_became_active":"2023-07-29T16:37:48.537936+0000","last_became_peered":"2023-07-29T16:37:48.537936+0000","last_unstale":"2023-07-29T16:38:37.530787+0000","last_undegraded":"2023-07-29T16:38:37.530787+0000","last_fullsized":"2023-07-29T16:38:37.530787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:23:42.596587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529162+0000","last_change":"2023-07-29T16:37:53.569108+0000","last_active":"2023-07-29T16:38:37.529162+0000","last_peered":"2023-07-29T16:38:37.529162+0000","last_clean":"2023-07-29T16:38:37.529162+0000","last_became_active":"2023-07-29T16:37:53.568741+0000","last_became_peered":"2023-07-29T16:37:53.568741+0000","last_unstale":"2023-07-29T16:38:37.529162+0000","last_undegraded":"2023-07-29T16:38:37.529162+0000","last_fullsized":"2023-07-29T16:38:37.529162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530694+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:38:37.530694+0000","last_peered":"2023-07-29T16:38:37.530694+0000","last_clean":"2023-07-29T16:38:37.530694+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:38:37.530694+0000","last_undegraded":"2023-07-29T16:38:37.530694+0000","last_fullsized":"2023-07-29T16:38:37.530694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"35'4134","reported_seq":4158,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.510159+0000","last_change":"2023-07-29T16:38:15.002836+0000","last_active":"2023-07-29T16:38:40.510159+0000","last_peered":"2023-07-29T16:38:40.510159+0000","last_clean":"2023-07-29T16:38:40.510159+0000","last_became_active":"2023-07-29T16:38:15.002549+0000","last_became_peered":"2023-07-29T16:38:15.002549+0000","last_unstale":"2023-07-29T16:38:40.510159+0000","last_undegraded":"2023-07-29T16:38:40.510159+0000","last_fullsized":"2023-07-29T16:38:40.510159+0000","mapping_epoch":19,"log_start":"22'400","ondisk_log_start":"22'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3734,"log_dups_size":0,"ondisk_log_size":3734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:32:13.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270925824,"num_objects":4134,"num_object_clones":0,"num_object_copies":8268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4134,"num_write_kb":264576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529464+0000","last_change":"2023-07-29T16:37:53.568106+0000","last_active":"2023-07-29T16:38:37.529464+0000","last_peered":"2023-07-29T16:38:37.529464+0000","last_clean":"2023-07-29T16:38:37.529464+0000","last_became_active":"2023-07-29T16:37:53.567849+0000","last_became_peered":"2023-07-29T16:37:53.567849+0000","last_unstale":"2023-07-29T16:38:37.529464+0000","last_undegraded":"2023-07-29T16:38:37.529464+0000","last_fullsized":"2023-07-29T16:38:37.529464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:39.810297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529559+0000","last_change":"2023-07-29T16:37:48.539892+0000","last_active":"2023-07-29T16:38:37.529559+0000","last_peered":"2023-07-29T16:38:37.529559+0000","last_clean":"2023-07-29T16:38:37.529559+0000","last_became_active":"2023-07-29T16:37:48.539499+0000","last_became_peered":"2023-07-29T16:37:48.539499+0000","last_unstale":"2023-07-29T16:38:37.529559+0000","last_undegraded":"2023-07-29T16:38:37.529559+0000","last_fullsized":"2023-07-29T16:38:37.529559+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:25:05.950776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528596+0000","last_change":"2023-07-29T16:37:53.955458+0000","last_active":"2023-07-29T16:38:37.528596+0000","last_peered":"2023-07-29T16:38:37.528596+0000","last_clean":"2023-07-29T16:38:37.528596+0000","last_became_active":"2023-07-29T16:37:53.955030+0000","last_became_peered":"2023-07-29T16:37:53.955030+0000","last_unstale":"2023-07-29T16:38:37.528596+0000","last_undegraded":"2023-07-29T16:38:37.528596+0000","last_fullsized":"2023-07-29T16:38:37.528596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"35'4172","reported_seq":4196,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-29T16:38:40.493590+0000","last_change":"2023-07-29T16:38:15.003063+0000","last_active":"2023-07-29T16:38:40.493590+0000","last_peered":"2023-07-29T16:38:40.493590+0000","last_clean":"2023-07-29T16:38:40.493590+0000","last_became_active":"2023-07-29T16:38:15.002814+0000","last_became_peered":"2023-07-29T16:38:15.002814+0000","last_unstale":"2023-07-29T16:38:40.493590+0000","last_undegraded":"2023-07-29T16:38:40.493590+0000","last_fullsized":"2023-07-29T16:38:40.493590+0000","mapping_epoch":19,"log_start":"21'200","ondisk_log_start":"21'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:07:17.294156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273416192,"num_objects":4172,"num_object_clones":0,"num_object_copies":8344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4172,"num_write_kb":267008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528736+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:38:37.528736+0000","last_peered":"2023-07-29T16:38:37.528736+0000","last_clean":"2023-07-29T16:38:37.528736+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:38:37.528736+0000","last_undegraded":"2023-07-29T16:38:37.528736+0000","last_fullsized":"2023-07-29T16:38:37.528736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529425+0000","last_change":"2023-07-29T16:37:53.571162+0000","last_active":"2023-07-29T16:38:37.529425+0000","last_peered":"2023-07-29T16:38:37.529425+0000","last_clean":"2023-07-29T16:38:37.529425+0000","last_became_active":"2023-07-29T16:37:53.570844+0000","last_became_peered":"2023-07-29T16:37:53.570844+0000","last_unstale":"2023-07-29T16:38:37.529425+0000","last_undegraded":"2023-07-29T16:38:37.529425+0000","last_fullsized":"2023-07-29T16:38:37.529425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530231+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:38:37.530231+0000","last_peered":"2023-07-29T16:38:37.530231+0000","last_clean":"2023-07-29T16:38:37.530231+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:38:37.530231+0000","last_undegraded":"2023-07-29T16:38:37.530231+0000","last_fullsized":"2023-07-29T16:38:37.530231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530456+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:38:37.530456+0000","last_peered":"2023-07-29T16:38:37.530456+0000","last_clean":"2023-07-29T16:38:37.530456+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:38:37.530456+0000","last_undegraded":"2023-07-29T16:38:37.530456+0000","last_fullsized":"2023-07-29T16:38:37.530456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530622+0000","last_change":"2023-07-29T16:37:53.958316+0000","last_active":"2023-07-29T16:38:37.530622+0000","last_peered":"2023-07-29T16:38:37.530622+0000","last_clean":"2023-07-29T16:38:37.530622+0000","last_became_active":"2023-07-29T16:37:53.957027+0000","last_became_peered":"2023-07-29T16:37:53.957027+0000","last_unstale":"2023-07-29T16:38:37.530622+0000","last_undegraded":"2023-07-29T16:38:37.530622+0000","last_fullsized":"2023-07-29T16:38:37.530622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:34.776966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527090+0000","last_change":"2023-07-29T16:37:53.567672+0000","last_active":"2023-07-29T16:38:37.527090+0000","last_peered":"2023-07-29T16:38:37.527090+0000","last_clean":"2023-07-29T16:38:37.527090+0000","last_became_active":"2023-07-29T16:37:53.566787+0000","last_became_peered":"2023-07-29T16:37:53.566787+0000","last_unstale":"2023-07-29T16:38:37.527090+0000","last_undegraded":"2023-07-29T16:38:37.527090+0000","last_fullsized":"2023-07-29T16:38:37.527090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:04:04.325232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.527148+0000","last_change":"2023-07-29T16:37:53.956793+0000","last_active":"2023-07-29T16:38:37.527148+0000","last_peered":"2023-07-29T16:38:37.527148+0000","last_clean":"2023-07-29T16:38:37.527148+0000","last_became_active":"2023-07-29T16:37:53.955919+0000","last_became_peered":"2023-07-29T16:37:53.955919+0000","last_unstale":"2023-07-29T16:38:37.527148+0000","last_undegraded":"2023-07-29T16:38:37.527148+0000","last_fullsized":"2023-07-29T16:38:37.527148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530914+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:38:37.530914+0000","last_peered":"2023-07-29T16:38:37.530914+0000","last_clean":"2023-07-29T16:38:37.530914+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:38:37.530914+0000","last_undegraded":"2023-07-29T16:38:37.530914+0000","last_fullsized":"2023-07-29T16:38:37.530914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.526723+0000","last_change":"2023-07-29T16:37:53.957079+0000","last_active":"2023-07-29T16:38:37.526723+0000","last_peered":"2023-07-29T16:38:37.526723+0000","last_clean":"2023-07-29T16:38:37.526723+0000","last_became_active":"2023-07-29T16:37:53.956724+0000","last_became_peered":"2023-07-29T16:37:53.956724+0000","last_unstale":"2023-07-29T16:38:37.526723+0000","last_undegraded":"2023-07-29T16:38:37.526723+0000","last_fullsized":"2023-07-29T16:38:37.526723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:11:28.138422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529523+0000","last_change":"2023-07-29T16:37:53.568922+0000","last_active":"2023-07-29T16:38:37.529523+0000","last_peered":"2023-07-29T16:38:37.529523+0000","last_clean":"2023-07-29T16:38:37.529523+0000","last_became_active":"2023-07-29T16:37:53.568438+0000","last_became_peered":"2023-07-29T16:37:53.568438+0000","last_unstale":"2023-07-29T16:38:37.529523+0000","last_undegraded":"2023-07-29T16:38:37.529523+0000","last_fullsized":"2023-07-29T16:38:37.529523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:55:00.398312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530041+0000","last_change":"2023-07-29T16:37:53.957556+0000","last_active":"2023-07-29T16:38:37.530041+0000","last_peered":"2023-07-29T16:38:37.530041+0000","last_clean":"2023-07-29T16:38:37.530041+0000","last_became_active":"2023-07-29T16:37:53.956990+0000","last_became_peered":"2023-07-29T16:37:53.956990+0000","last_unstale":"2023-07-29T16:38:37.530041+0000","last_undegraded":"2023-07-29T16:38:37.530041+0000","last_fullsized":"2023-07-29T16:38:37.530041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:01:04.489871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.529554+0000","last_change":"2023-07-29T16:37:53.570896+0000","last_active":"2023-07-29T16:38:37.529554+0000","last_peered":"2023-07-29T16:38:37.529554+0000","last_clean":"2023-07-29T16:38:37.529554+0000","last_became_active":"2023-07-29T16:37:53.570625+0000","last_became_peered":"2023-07-29T16:37:53.570625+0000","last_unstale":"2023-07-29T16:38:37.529554+0000","last_undegraded":"2023-07-29T16:38:37.529554+0000","last_fullsized":"2023-07-29T16:38:37.529554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:43:35.090929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.525999+0000","last_change":"2023-07-29T16:37:53.961357+0000","last_active":"2023-07-29T16:38:37.525999+0000","last_peered":"2023-07-29T16:38:37.525999+0000","last_clean":"2023-07-29T16:38:37.525999+0000","last_became_active":"2023-07-29T16:37:53.960132+0000","last_became_peered":"2023-07-29T16:37:53.960132+0000","last_unstale":"2023-07-29T16:38:37.525999+0000","last_undegraded":"2023-07-29T16:38:37.525999+0000","last_fullsized":"2023-07-29T16:38:37.525999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:41:06.582773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.525941+0000","last_change":"2023-07-29T16:37:53.961761+0000","last_active":"2023-07-29T16:38:37.525941+0000","last_peered":"2023-07-29T16:38:37.525941+0000","last_clean":"2023-07-29T16:38:37.525941+0000","last_became_active":"2023-07-29T16:37:53.960671+0000","last_became_peered":"2023-07-29T16:37:53.960671+0000","last_unstale":"2023-07-29T16:38:37.525941+0000","last_undegraded":"2023-07-29T16:38:37.525941+0000","last_fullsized":"2023-07-29T16:38:37.525941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528432+0000","last_change":"2023-07-29T16:37:53.958046+0000","last_active":"2023-07-29T16:38:37.528432+0000","last_peered":"2023-07-29T16:38:37.528432+0000","last_clean":"2023-07-29T16:38:37.528432+0000","last_became_active":"2023-07-29T16:37:53.957321+0000","last_became_peered":"2023-07-29T16:37:53.957321+0000","last_unstale":"2023-07-29T16:38:37.528432+0000","last_undegraded":"2023-07-29T16:38:37.528432+0000","last_fullsized":"2023-07-29T16:38:37.528432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:21:26.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530789+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:38:37.530789+0000","last_peered":"2023-07-29T16:38:37.530789+0000","last_clean":"2023-07-29T16:38:37.530789+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:38:37.530789+0000","last_undegraded":"2023-07-29T16:38:37.530789+0000","last_fullsized":"2023-07-29T16:38:37.530789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.528935+0000","last_change":"2023-07-29T16:37:53.958433+0000","last_active":"2023-07-29T16:38:37.528935+0000","last_peered":"2023-07-29T16:38:37.528935+0000","last_clean":"2023-07-29T16:38:37.528935+0000","last_became_active":"2023-07-29T16:37:53.957657+0000","last_became_peered":"2023-07-29T16:37:53.957657+0000","last_unstale":"2023-07-29T16:38:37.528935+0000","last_undegraded":"2023-07-29T16:38:37.528935+0000","last_fullsized":"2023-07-29T16:38:37.528935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-29T16:38:37.530789+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:38:37.530789+0000","last_peered":"2023-07-29T16:38:37.530789+0000","last_clean":"2023-07-29T16:38:37.530789+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:38:37.530789+0000","last_undegraded":"2023-07-29T16:38:37.530789+0000","last_fullsized":"2023-07-29T16:38:37.530789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4276420608,"num_objects":65253,"num_object_clones":0,"num_object_copies":130506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65253,"num_write_kb":4176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":534638592,"data_stored":8554217472,"data_compressed":40963258,"data_compressed_allocated":534638592,"data_compressed_original":8554217472,"omap_allocated":0,"internal_metadata":0},"log_size":60653,"ondisk_log_size":60653,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304820,"kb_used_data":207340,"kb_used_omap":0,"kb_used_meta":97472,"kb_avail":94067020,"statfs":{"total":96636764160,"available":96324628480,"internally_reserved":0,"allocated":212316160,"data_stored":3391229625,"data_compressed":16238582,"data_compressed_allocated":211943424,"data_compressed_original":3391094784,"omap_allocated":0,"internal_metadata":99811328},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.185}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225224,"kb_used_data":145788,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":94146616,"statfs":{"total":96636764160,"available":96406134784,"internally_reserved":0,"allocated":149286912,"data_stored":2382173507,"data_compressed":11413994,"data_compressed_allocated":148877312,"data_compressed_original":2382020608,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230704,"kb_used_data":163560,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94141136,"statfs":{"total":96636764160,"available":96400523264,"internally_reserved":0,"allocated":167485440,"data_stored":2673219499,"data_compressed":12807680,"data_compressed_allocated":167067648,"data_compressed_original":2673065984,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":150360064,"data_stored":2405761024,"data_compressed":11520427,"data_compressed_allocated":150360064,"data_compressed_original":2405761024,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167141376,"data_stored":2674262016,"data_compressed":12806097,"data_compressed_allocated":167141376,"data_compressed_original":2674262016,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":217137152,"data_stored":3474194432,"data_compressed":16636734,"data_compressed_allocated":217137152,"data_compressed_original":3474194432,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:38:42.437 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [1, 2] 2023-07-29T16:38:42.438 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.19', '1', '2'] 2023-07-29T16:38:42.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.19 1 2 2023-07-29T16:38:42.526 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:42.523+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:42.613 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:42.613 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:42.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.614 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:69702 5.2 5:4afb1f08:::benchmark_data_smithi070_97781_object69701:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:42.614 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.607844+0000", 2023-07-29T16:38:42.614 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003015588, 2023-07-29T16:38:42.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003043942, 2023-07-29T16:38:42.615 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:42.615 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:42.615 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:42.616 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:42.616 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.616 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 69702 2023-07-29T16:38:42.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.617 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:42.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:42.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607844+0000", 2023-07-29T16:38:42.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:42.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607844+0000", 2023-07-29T16:38:42.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607843+0000", 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607896+0000", 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3056999999999997e-05 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:42.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607905+0000", 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8189999999999998e-06 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607912+0000", 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9829999999999999e-06 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.607953+0000", 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0964999999999998e-05 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:42.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608053+0000", 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9581999999999996e-05 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608142+0000", 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9567000000000005e-05 2023-07-29T16:38:42.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610508+0000", 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023658220000000001 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:42.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:69699 5.5 e36/19 5:ae103180:::benchmark_data_smithi070_97781_object69698:head v 36'4357, mlcod=36'4355)", 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.608113+0000", 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002746545, 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028676650000000001, 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:42.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608113+0000", 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:42.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608113+0000", 2023-07-29T16:38:42.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608113+0000", 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608194+0000", 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1046999999999998e-05 2023-07-29T16:38:42.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608199+0000", 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.541e-06 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608203+0000", 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8290000000000001e-06 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608236+0000", 2023-07-29T16:38:42.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2818999999999999e-05 2023-07-29T16:38:42.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:42.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608254+0000", 2023-07-29T16:38:42.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7604999999999998e-05 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:69704 5.9 5:9dbc740d:::benchmark_data_smithi070_97781_object69703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.608886+0000", 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0019735859999999998, 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021655210000000001, 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:42.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 69704 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608886+0000", 2023-07-29T16:38:42.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608886+0000", 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608885+0000", 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:42.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608943+0000", 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7584999999999998e-05 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608956+0000", 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.269e-05 2023-07-29T16:38:42.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.608963+0000", 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0430000000000002e-06 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.609006+0000", 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2796999999999997e-05 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.609141+0000", 2023-07-29T16:38:42.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000135122 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.609288+0000", 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014758800000000001 2023-07-29T16:38:42.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:69705 5.5 e36/19 5:ac52225a:::benchmark_data_smithi070_97781_object69704:head v 36'4358, mlcod=36'4355)", 2023-07-29T16:38:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.610239+0000", 2023-07-29T16:38:42.643 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00062075200000000002, 2023-07-29T16:38:42.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088392600000000005, 2023-07-29T16:38:42.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:42.643 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:42.643 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:42.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:42.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610239+0000", 2023-07-29T16:38:42.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610239+0000", 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610238+0000", 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610293+0000", 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4512000000000003e-05 2023-07-29T16:38:42.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610309+0000", 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5925000000000001e-05 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:42.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610314+0000", 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0520000000000001e-06 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610344+0000", 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0337000000000001e-05 2023-07-29T16:38:42.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.610360+0000", 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5971999999999999e-05 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:42.650 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:42.650 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 4 2023-07-29T16:38:42.650 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:42.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:42.652 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:42.648+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:42.751 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:42.749+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:42.822 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:42.822 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:42.823 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:42.823 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:42.823 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:42.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:42.853 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:42.849+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:42.953 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:42.950+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:43.008 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 60.482451394999998, 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057494413999997, 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057469558999998, 2023-07-29T16:38:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057437614999998, 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057416003999997, 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057391944000003, 2023-07-29T16:38:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057356796000001, 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:43.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.088 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057320681999997, 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017397388999999999, 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946618+0000", 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946623+0000", 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946629+0000", 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946635+0000", 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0780000000000001e-06 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947265+0000", 2023-07-29T16:38:43.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00062967399999999999 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947270+0000", 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7969999999999997e-06 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955455+0000", 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0081848809999999998 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955575+0000", 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011942099999999999 2023-07-29T16:38:43.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955770+0000", 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019582099999999999 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958413+0000", 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002642976 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963924+0000", 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055107239999999998 2023-07-29T16:38:43.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963973+0000", 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9307000000000001e-05 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964016+0000", 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2401000000000003e-05 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057295779, 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:43.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:43.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.110 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057173489, 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:43.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:43.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:43.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:43.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057148570000003, 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017228396999999999, 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946791+0000", 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946790+0000", 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946803+0000", 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2391999999999999e-05 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946813+0000", 2023-07-29T16:38:43.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0288999999999999e-05 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946825+0000", 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2115e-05 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946971+0000", 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014569100000000001 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946978+0000", 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3599999999999998e-06 2023-07-29T16:38:43.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954756+0000", 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0077778409999999997 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955233+0000", 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000477221 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.955410+0000", 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000176563 2023-07-29T16:38:43.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957874+0000", 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002463935 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963948+0000", 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060748010000000003 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963994+0000", 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5407000000000001e-05 2023-07-29T16:38:43.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964019+0000", 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5219e-05 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057097026999998, 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.133 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:43.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:43.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:43.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057049442999997, 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:43.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:43.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:43.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:43.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:43.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.154 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 49.057026157000003, 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:43.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:43.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.163 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:59921 5.7 5:ecfeab76:::benchmark_data_smithi070_97781_object59920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.981114668, 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018023232, 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 59921 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:43.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022845+0000", 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1282000000000001e-05 2023-07-29T16:38:43.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022851+0000", 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022854+0000", 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.506e-06 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027040+0000", 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041851910000000004 2023-07-29T16:38:43.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027131+0000", 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1481e-05 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:43.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027224+0000", 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2925999999999998e-05 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.035723+0000", 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0084984220000000003 2023-07-29T16:38:43.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040758+0000", 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050352360000000002 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040808+0000", 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0466000000000001e-05 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040848+0000", 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9511999999999997e-05 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.173 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61116 5.1 5:83f1337b:::benchmark_data_smithi070_97781_object61115:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.4271512959999999, 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017176276000000001, 2023-07-29T16:38:43.174 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61116 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576788+0000", 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576787+0000", 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576878+0000", 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0397999999999997e-05 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576887+0000", 2023-07-29T16:38:43.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9299999999999992e-06 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.576892+0000", 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9840000000000001e-06 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.578771+0000", 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001879447 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.578878+0000", 2023-07-29T16:38:43.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107064 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.579028+0000", 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150323 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.588964+0000", 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357019999999994 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593899+0000", 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049349759999999998 2023-07-29T16:38:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593938+0000", 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8707000000000001e-05 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.593964+0000", 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6347e-05 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61411 5.f 5:f97c8622:::benchmark_data_smithi070_97781_object61410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.2914806060000004, 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018542692, 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61411 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712458+0000", 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712525+0000", 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6715000000000001e-05 2023-07-29T16:38:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712534+0000", 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2920000000000001e-06 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712541+0000", 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712589+0000", 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8489999999999998e-05 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712724+0000", 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134208 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712894+0000", 2023-07-29T16:38:43.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170471 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727900+0000", 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015006143 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730936+0000", 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030355849999999999 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730971+0000", 2023-07-29T16:38:43.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731001+0000", 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0267999999999999e-05 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61419 5.f 5:f0534ab8:::benchmark_data_smithi070_97781_object61418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.286127746, 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018012489999999999, 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61419 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:43.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717842+0000", 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0868000000000003e-05 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717850+0000", 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3080000000000008e-06 2023-07-29T16:38:43.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717857+0000", 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3790000000000003e-06 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.724902+0000", 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070455149999999996 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725049+0000", 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014657400000000001 2023-07-29T16:38:43.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725202+0000", 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015374400000000001 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731053+0000", 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058501719999999998 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735779+0000", 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047264890000000004 2023-07-29T16:38:43.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735806+0000", 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7440000000000002e-05 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735824+0000", 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7438000000000001e-05 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61420 5.7 5:ef4ebe24:::benchmark_data_smithi070_97781_object61419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.2859833299999996, 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017443556999999998, 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61420 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717955+0000", 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718009+0000", 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3974000000000002e-05 2023-07-29T16:38:43.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718017+0000", 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2139999999999999e-06 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718022+0000", 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3449999999999996e-06 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727958+0000", 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357100000000004 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728039+0000", 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1358000000000003e-05 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728132+0000", 2023-07-29T16:38:43.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3552000000000001e-05 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735340+0000", 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.007207677 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735345+0000", 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4379999999999997e-06 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735375+0000", 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0236e-05 2023-07-29T16:38:43.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735399+0000", 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4544000000000001e-05 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:70327 5.7 5:e4aa3c7c:::benchmark_data_smithi070_97781_object70326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.098915092999999996, 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.01835469, 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:43.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 70327 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:43.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:43.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905059+0000", 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.574e-05 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905068+0000", 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4120000000000001e-06 2023-07-29T16:38:43.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905073+0000", 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.587e-06 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:43.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907576+0000", 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025028630000000001 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907691+0000", 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114881 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907833+0000", 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000142001 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.910312+0000", 2023-07-29T16:38:43.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024790379999999998 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923329+0000", 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013016872000000001 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923357+0000", 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7940999999999999e-05 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923379+0000", 2023-07-29T16:38:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1769000000000001e-05 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:43.226 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:43.227 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 27 16 70693 70677 163.591 135.688 0.00316039 0.00611013 2023-07-29T16:38:43.228 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:43.224+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:43.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:43.328 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:43.325+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:43.415 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71377 5.c 5:3be093c1:::benchmark_data_smithi070_97781_object71376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.407181+0000", 2023-07-29T16:38:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047504649999999997, 2023-07-29T16:38:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047818610000000001, 2023-07-29T16:38:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71377 2023-07-29T16:38:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407181+0000", 2023-07-29T16:38:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407181+0000", 2023-07-29T16:38:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407179+0000", 2023-07-29T16:38:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407241+0000", 2023-07-29T16:38:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2028999999999999e-05 2023-07-29T16:38:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407253+0000", 2023-07-29T16:38:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1302e-05 2023-07-29T16:38:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407260+0000", 2023-07-29T16:38:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5619999999999998e-06 2023-07-29T16:38:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407306+0000", 2023-07-29T16:38:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5325999999999999e-05 2023-07-29T16:38:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407411+0000", 2023-07-29T16:38:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104918 2023-07-29T16:38:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407496+0000", 2023-07-29T16:38:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5617000000000004e-05 2023-07-29T16:38:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71378 5.3 5:c268af7d:::benchmark_data_smithi070_97781_object71377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.407293+0000", 2023-07-29T16:38:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0046388000000000002, 2023-07-29T16:38:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047551950000000003, 2023-07-29T16:38:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71378 2023-07-29T16:38:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407293+0000", 2023-07-29T16:38:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407293+0000", 2023-07-29T16:38:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407292+0000", 2023-07-29T16:38:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407353+0000", 2023-07-29T16:38:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1340000000000006e-05 2023-07-29T16:38:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407361+0000", 2023-07-29T16:38:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.311e-06 2023-07-29T16:38:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407367+0000", 2023-07-29T16:38:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1709999999999999e-06 2023-07-29T16:38:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407779+0000", 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041219199999999997 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407891+0000", 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011186199999999999 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.407996+0000", 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010539600000000001 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71380 5.a 5:5c273099:::benchmark_data_smithi070_97781_object71379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.409773+0000", 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0021579360000000001, 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023527829999999998, 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71380 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409773+0000", 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409773+0000", 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409773+0000", 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409868+0000", 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5926000000000003e-05 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409876+0000", 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.841e-06 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409882+0000", 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3789999999999997e-06 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.409915+0000", 2023-07-29T16:38:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3408999999999998e-05 2023-07-29T16:38:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410008+0000", 2023-07-29T16:38:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2712000000000003e-05 2023-07-29T16:38:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410129+0000", 2023-07-29T16:38:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121636 2023-07-29T16:38:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71385 5.3 5:c6360986:::benchmark_data_smithi070_97781_object71384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410054+0000", 2023-07-29T16:38:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0018775199999999999, 2023-07-29T16:38:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002150047, 2023-07-29T16:38:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71385 2023-07-29T16:38:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410054+0000", 2023-07-29T16:38:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410054+0000", 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410053+0000", 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410154+0000", 2023-07-29T16:38:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100912 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410173+0000", 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8749999999999998e-05 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410182+0000", 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6930000000000002e-06 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410225+0000", 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3102999999999997e-05 2023-07-29T16:38:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410326+0000", 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100628 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410424+0000", 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7483000000000002e-05 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71386 5.a 5:5f67d8dc:::benchmark_data_smithi070_97781_object71385:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410199+0000", 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0017327690000000001, 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020869249999999999, 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71386 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410199+0000", 2023-07-29T16:38:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410199+0000", 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410198+0000", 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410231+0000", 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3559000000000002e-05 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410242+0000", 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0754000000000001e-05 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410251+0000", 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2620000000000004e-06 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.412101+0000", 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001849987 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.412246+0000", 2023-07-29T16:38:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014423800000000001 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:71381 5.1 e36/19 5:890f0b06:::benchmark_data_smithi070_97781_object71380:head v 36'4521, mlcod=36'4518)", 2023-07-29T16:38:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410389+0000", 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001542426, 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019632489999999998, 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410389+0000", 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410389+0000", 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410388+0000", 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410505+0000", 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116711 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410516+0000", 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0557000000000001e-05 2023-07-29T16:38:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410522+0000", 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7109999999999998e-06 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410565+0000", 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3066999999999999e-05 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410586+0000", 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0801e-05 2023-07-29T16:38:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71387 5.c 5:323295f7:::benchmark_data_smithi070_97781_object71386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410425+0000", 2023-07-29T16:38:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001506203, 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019958200000000001, 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71387 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410425+0000", 2023-07-29T16:38:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410425+0000", 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410425+0000", 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410534+0000", 2023-07-29T16:38:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109169 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410544+0000", 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.076e-05 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410551+0000", 2023-07-29T16:38:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9e-06 2023-07-29T16:38:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410606+0000", 2023-07-29T16:38:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4886999999999998e-05 2023-07-29T16:38:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410718+0000", 2023-07-29T16:38:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011221 2023-07-29T16:38:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410849+0000", 2023-07-29T16:38:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013048199999999999 2023-07-29T16:38:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:71384 5.e e36/19 5:743baaa6:::benchmark_data_smithi070_97781_object71383:head v 36'4376, mlcod=36'4374)", 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410491+0000", 2023-07-29T16:38:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001440059, 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020168249999999999, 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410491+0000", 2023-07-29T16:38:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410491+0000", 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410491+0000", 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410605+0000", 2023-07-29T16:38:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011427800000000001 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410614+0000", 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9269999999999994e-06 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410620+0000", 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8640000000000001e-06 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410680+0000", 2023-07-29T16:38:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0517999999999999e-05 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410701+0000", 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0431000000000001e-05 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:71382 5.7 e36/19 5:e3158cdc:::benchmark_data_smithi070_97781_object71381:head v 36'4464, mlcod=36'4461)", 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.410535+0000", 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001396748, 2023-07-29T16:38:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020401830000000001, 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410535+0000", 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410535+0000", 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410534+0000", 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410642+0000", 2023-07-29T16:38:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108114 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410652+0000", 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1589999999999999e-06 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410658+0000", 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5259999999999999e-06 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410711+0000", 2023-07-29T16:38:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3374000000000001e-05 2023-07-29T16:38:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.410729+0000", 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7944999999999998e-05 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71370 5.3 5:c1077fc0:::benchmark_data_smithi070_97781_object71369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.403447+0000", 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0084842200000000006, 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091999939999999995, 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71370 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403447+0000", 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403447+0000", 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403446+0000", 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403489+0000", 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2854e-05 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403502+0000", 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2967e-05 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403511+0000", 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9449999999999999e-06 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405834+0000", 2023-07-29T16:38:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023236329999999999 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405965+0000", 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130576 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.406093+0000", 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128357 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71371 5.a 5:5a1c64ae:::benchmark_data_smithi070_97781_object71370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.403550+0000", 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0083809399999999999, 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.009199512, 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71371 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403550+0000", 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403550+0000", 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403550+0000", 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403685+0000", 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013542299999999999 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403696+0000", 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1259e-05 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.403703+0000", 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3949999999999998e-06 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405834+0000", 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021313870000000002 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405967+0000", 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132416 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.406138+0000", 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017102900000000001 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.408386+0000", 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002248753 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:71373 5.2 e36/19 5:485265bc:::benchmark_data_smithi070_97781_object71372:head v 36'4503, mlcod=36'4500)", 2023-07-29T16:38:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.404047+0000", 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0078848849999999995, 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087820150000000007, 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404047+0000", 2023-07-29T16:38:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404047+0000", 2023-07-29T16:38:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404046+0000", 2023-07-29T16:38:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404109+0000", 2023-07-29T16:38:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3318999999999995e-05 2023-07-29T16:38:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404119+0000", 2023-07-29T16:38:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6390000000000004e-06 2023-07-29T16:38:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.404126+0000", 2023-07-29T16:38:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6080000000000001e-06 2023-07-29T16:38:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405842+0000", 2023-07-29T16:38:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001716984 2023-07-29T16:38:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.405860+0000", 2023-07-29T16:38:43.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7102999999999999e-05 2023-07-29T16:38:43.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.538 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.539 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:43.539 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2023-07-29T16:38:43.539 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:set 4.19 pg_upmap mapping to [1,2] 2023-07-29T16:38:43.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:43.542 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:43.538+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:43.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:38:43.641 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:43.639+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:43.742 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:43.739+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:43.772 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:43.772 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:43.772 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:43.772 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:43.773 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:43.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:43.851 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:43.841+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:43.943 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:43.940+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:43.983 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2023-07-29T16:38:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40186 5.6 5:65b7fe91:::benchmark_data_smithi070_97781_object40185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.527511513, 2023-07-29T16:38:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016297306000000001, 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40186 2023-07-29T16:38:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451747+0000", 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8999999999999994e-05 2023-07-29T16:38:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451754+0000", 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5209999999999997e-06 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451760+0000", 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.207e-06 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456331+0000", 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045710070000000002 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456465+0000", 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013328299999999999 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456603+0000", 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013830400000000001 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.458529+0000", 2023-07-29T16:38:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019264880000000001 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467888+0000", 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093583360000000001 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467923+0000", 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5358000000000003e-05 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467945+0000", 2023-07-29T16:38:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2354999999999999e-05 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40211 5.6 5:6c09c9f2:::benchmark_data_smithi070_97781_object40210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.519607272, 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017039855999999999, 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40211 2023-07-29T16:38:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459624+0000", 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1897999999999995e-05 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459640+0000", 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6555e-05 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459646+0000", 2023-07-29T16:38:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6559999999999997e-06 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.464809+0000", 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051632960000000004 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.464939+0000", 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013012200000000001 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.465048+0000", 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108528 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.471715+0000", 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066671489999999998 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476508+0000", 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047928490000000001 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476554+0000", 2023-07-29T16:38:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5976000000000002e-05 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476592+0000", 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8526999999999999e-05 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40239 5.a 5:525bfd5d:::benchmark_data_smithi070_97781_object40238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.503740630999999, 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017227665999999999, 2023-07-29T16:38:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40239 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:44.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475418+0000", 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475489+0000", 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1304999999999996e-05 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475498+0000", 2023-07-29T16:38:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8300000000000002e-06 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475505+0000", 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8379999999999996e-06 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475547+0000", 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1476000000000001e-05 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475554+0000", 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0859999999999996e-06 2023-07-29T16:38:44.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486757+0000", 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011203516 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486871+0000", 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114267 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486983+0000", 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111632 2023-07-29T16:38:44.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.491381+0000", 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043974840000000001 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492539+0000", 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011581689999999999 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492595+0000", 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6039000000000003e-05 2023-07-29T16:38:44.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492647+0000", 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1853e-05 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40242 5.c 5:39dd90c4:::benchmark_data_smithi070_97781_object40241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.502193178000001, 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016618859999999999, 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.020 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40242 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477026+0000", 2023-07-29T16:38:44.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0248000000000003e-05 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477040+0000", 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4576000000000001e-05 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477046+0000", 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.203e-06 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477073+0000", 2023-07-29T16:38:44.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7018000000000001e-05 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477076+0000", 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.298e-06 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486902+0000", 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098260650000000001 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486988+0000", 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5607999999999998e-05 2023-07-29T16:38:44.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.487107+0000", 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011917 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.490961+0000", 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038541640000000002 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493518+0000", 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002557064 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493550+0000", 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2123999999999999e-05 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493585+0000", 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5132000000000002e-05 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40243 5.c 5:336e13cb:::benchmark_data_smithi070_97781_object40242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.031 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.502092955, 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017036386000000001, 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40243 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477066+0000", 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477150+0000", 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.331e-05 2023-07-29T16:38:44.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477155+0000", 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2680000000000002e-06 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477159+0000", 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8870000000000002e-06 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477202+0000", 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3089e-05 2023-07-29T16:38:44.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477208+0000", 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488598+0000", 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011390002999999999 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488714+0000", 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115252 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488860+0000", 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014592899999999999 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493481+0000", 2023-07-29T16:38:44.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046215989999999997 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494019+0000", 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053786399999999999 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494068+0000", 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8686000000000001e-05 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494103+0000", 2023-07-29T16:38:44.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5385000000000001e-05 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:41599 5.5 5:aedc4b32:::benchmark_data_smithi070_97781_object41598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.037593+0000", 2023-07-29T16:38:44.043 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.941566230999999, 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015237741000000001, 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41599 2023-07-29T16:38:44.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037593+0000", 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037593+0000", 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037593+0000", 2023-07-29T16:38:44.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037737+0000", 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000144146 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037747+0000", 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5389999999999996e-06 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037767+0000", 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.067e-05 2023-07-29T16:38:44.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037798+0000", 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1228e-05 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.037894+0000", 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6057999999999994e-05 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.038006+0000", 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011158999999999999 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.040282+0000", 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002276209 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.052751+0000", 2023-07-29T16:38:44.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012468625000000001 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.052795+0000", 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3683000000000002e-05 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.052831+0000", 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6551999999999998e-05 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42293 5.c 5:39bcdf78:::benchmark_data_smithi070_97781_object42292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.663804166, 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015464794, 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.054 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.055 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.056 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42293 2023-07-29T16:38:44.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.057 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:44.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:44.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:44.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315466+0000", 2023-07-29T16:38:44.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111263 2023-07-29T16:38:44.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315474+0000", 2023-07-29T16:38:44.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2239999999999995e-06 2023-07-29T16:38:44.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315481+0000", 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8460000000000002e-06 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.320747+0000", 2023-07-29T16:38:44.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052656810000000004 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.320872+0000", 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012529199999999999 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.321022+0000", 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014948199999999999 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.323148+0000", 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021265210000000001 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330736+0000", 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075877870000000004 2023-07-29T16:38:44.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330784+0000", 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8121999999999998e-05 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330820+0000", 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6167000000000001e-05 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:43152 5.5 5:a4632811:::benchmark_data_smithi070_97781_object43151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.310692768999999, 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017897074999999998, 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.072 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.072 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.072 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43152 2023-07-29T16:38:44.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.073 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:44.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:44.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:44.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668507+0000", 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423999999999998e-05 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668512+0000", 2023-07-29T16:38:44.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.848e-06 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668515+0000", 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3560000000000001e-06 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670709+0000", 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021933600000000001 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670792+0000", 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3176999999999993e-05 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670872+0000", 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9820000000000005e-05 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.673062+0000", 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021906569999999999 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686276+0000", 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013213538 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686328+0000", 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2352999999999998e-05 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686364+0000", 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5877000000000002e-05 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53385 5.6 5:69ca3f5d:::benchmark_data_smithi070_97781_object53384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.9378591380000003, 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01561713, 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.085 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53385 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041300+0000", 2023-07-29T16:38:44.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041376+0000", 2023-07-29T16:38:44.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5660000000000004e-05 2023-07-29T16:38:44.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041385+0000", 2023-07-29T16:38:44.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3130000000000004e-06 2023-07-29T16:38:44.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041390+0000", 2023-07-29T16:38:44.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6280000000000004e-06 2023-07-29T16:38:44.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041419+0000", 2023-07-29T16:38:44.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9641e-05 2023-07-29T16:38:44.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041512+0000", 2023-07-29T16:38:44.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3129999999999998e-05 2023-07-29T16:38:44.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041601+0000", 2023-07-29T16:38:44.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8622000000000006e-05 2023-07-29T16:38:44.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.049553+0000", 2023-07-29T16:38:44.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079518920000000003 2023-07-29T16:38:44.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056824+0000", 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072715289999999997 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056875+0000", 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0492999999999999e-05 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056918+0000", 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2729999999999999e-05 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:61571 5.0 e35/19 5:03d28ec5:::benchmark_data_smithi070_97781_object61570:head v 35'3927, mlcod=35'3921)", 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.1876656609999996, 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0154626, 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:44.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791493+0000", 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791564+0000", 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0561000000000004e-05 2023-07-29T16:38:44.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791575+0000", 2023-07-29T16:38:44.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0821e-05 2023-07-29T16:38:44.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791581+0000", 2023-07-29T16:38:44.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8459999999999996e-06 2023-07-29T16:38:44.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797165+0000", 2023-07-29T16:38:44.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055846079999999996 2023-07-29T16:38:44.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797186+0000", 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0557e-05 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806885+0000", 2023-07-29T16:38:44.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096989339999999993 2023-07-29T16:38:44.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806957+0000", 2023-07-29T16:38:44.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1802000000000001e-05 2023-07-29T16:38:44.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.112 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.113 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:61572 5.8 e35/19 5:192310c5:::benchmark_data_smithi070_97781_object61571:head v 35'3845, mlcod=35'3842)", 2023-07-29T16:38:44.113 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:44.113 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.1875735130000002, 2023-07-29T16:38:44.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015290132999999999, 2023-07-29T16:38:44.114 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.114 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.114 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:44.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:44.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:44.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791619+0000", 2023-07-29T16:38:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3003999999999998e-05 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791627+0000", 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2009999999999999e-06 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791637+0000", 2023-07-29T16:38:44.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5449999999999992e-06 2023-07-29T16:38:44.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797155+0000", 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005518495 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797200+0000", 2023-07-29T16:38:44.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4669999999999998e-05 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806810+0000", 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.009610235 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806876+0000", 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6319e-05 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:69048 5.6 5:67bf39bc:::benchmark_data_smithi070_97781_object69047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.67392634, 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015369555, 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69048 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:44.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305341+0000", 2023-07-29T16:38:44.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010850599999999999 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305350+0000", 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305356+0000", 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4920000000000001e-06 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305383+0000", 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7555e-05 2023-07-29T16:38:44.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305471+0000", 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7682000000000005e-05 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305584+0000", 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011260300000000001 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.308699+0000", 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003115254 2023-07-29T16:38:44.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320539+0000", 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011840499000000001 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320577+0000", 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7348999999999998e-05 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320603+0000", 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6018999999999999e-05 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:69149 5.c 5:3ba6cabd:::benchmark_data_smithi070_97781_object69148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.352545+0000", 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.6266147659999999, 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015227565, 2023-07-29T16:38:44.134 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69149 2023-07-29T16:38:44.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352545+0000", 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352545+0000", 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352544+0000", 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352591+0000", 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7027000000000002e-05 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352604+0000", 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2602000000000001e-05 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.352614+0000", 2023-07-29T16:38:44.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0312999999999999e-05 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.357921+0000", 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053069090000000003 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.358013+0000", 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1754000000000003e-05 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.358112+0000", 2023-07-29T16:38:44.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9690000000000003e-05 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.362731+0000", 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046184570000000003 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.367695+0000", 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049646480000000003 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.367737+0000", 2023-07-29T16:38:44.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1628999999999997e-05 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.367772+0000", 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5333999999999997e-05 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:70154 5.6 5:6f3432b9:::benchmark_data_smithi070_97781_object70153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.1590258310000001, 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017493801, 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.145 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 70154 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:44.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820133+0000", 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820157+0000", 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3450000000000001e-05 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820162+0000", 2023-07-29T16:38:44.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6919999999999999e-06 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820167+0000", 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0239999999999997e-06 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822009+0000", 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018412649999999999 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822129+0000", 2023-07-29T16:38:44.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120337 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822248+0000", 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119028 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.824282+0000", 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020338690000000002 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837538+0000", 2023-07-29T16:38:44.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013255805000000001 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837589+0000", 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1694999999999999e-05 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837628+0000", 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8124999999999998e-05 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.155 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:70317 5.3 5:c381f24c:::benchmark_data_smithi070_97781_object70316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.076290601, 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016132971999999999, 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 70317 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902868+0000", 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902896+0000", 2023-07-29T16:38:44.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7044999999999999e-05 2023-07-29T16:38:44.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902904+0000", 2023-07-29T16:38:44.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0660000000000004e-06 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902910+0000", 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1079999999999998e-06 2023-07-29T16:38:44.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906503+0000", 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003593518 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906650+0000", 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014653999999999999 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906742+0000", 2023-07-29T16:38:44.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2134999999999998e-05 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.914586+0000", 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078445340000000002 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.918910+0000", 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043240539999999999 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.918954+0000", 2023-07-29T16:38:44.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640999999999998e-05 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.919002+0000", 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7888e-05 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.166 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71611 5.a 5:5a4e481d:::benchmark_data_smithi070_97781_object71610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.515119+0000", 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.46404037999999997, 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015234078, 2023-07-29T16:38:44.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71611 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.168 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515119+0000", 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515119+0000", 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515119+0000", 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515240+0000", 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012068700000000001 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515247+0000", 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515253+0000", 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9370000000000001e-06 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.521816+0000", 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065633970000000003 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.521927+0000", 2023-07-29T16:38:44.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110906 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.522059+0000", 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013187499999999999 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530265+0000", 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082063919999999999 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530278+0000", 2023-07-29T16:38:44.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2731999999999999e-05 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530317+0000", 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8813000000000003e-05 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530353+0000", 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6346000000000001e-05 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71612 5.a 5:5e4476e9:::benchmark_data_smithi070_97781_object71611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.46389639300000002, 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017276524000000001, 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71612 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:44.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515315+0000", 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2842e-05 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515323+0000", 2023-07-29T16:38:44.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3289999999999996e-06 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515333+0000", 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0111e-05 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524081+0000", 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087477189999999993 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524179+0000", 2023-07-29T16:38:44.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8077000000000003e-05 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524277+0000", 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8461999999999993e-05 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530362+0000", 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00608532 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532453+0000", 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020906190000000002 2023-07-29T16:38:44.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532504+0000", 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0995999999999998e-05 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532540+0000", 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5698000000000003e-05 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.188 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:72129 5.3 5:cd3fb223:::benchmark_data_smithi070_97781_object72128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.21411633899999999, 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016482598000000001, 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.189 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72129 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:44.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765102+0000", 2023-07-29T16:38:44.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8901999999999999e-05 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765112+0000", 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0597999999999999e-05 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765119+0000", 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9550000000000003e-06 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.768864+0000", 2023-07-29T16:38:44.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037445159999999998 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.768982+0000", 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118625 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.769104+0000", 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121273 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.774912+0000", 2023-07-29T16:38:44.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058088230000000003 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781462+0000", 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065494170000000001 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781499+0000", 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7137e-05 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781526+0000", 2023-07-29T16:38:44.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6971e-05 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:72142 5.3 5:c0928b9a:::benchmark_data_smithi070_97781_object72141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:44.199 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.20814487200000001, 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016602832000000001, 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72142 2023-07-29T16:38:44.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771014+0000", 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:44.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771045+0000", 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1677000000000002e-05 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771055+0000", 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3039999999999994e-06 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771062+0000", 2023-07-29T16:38:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1430000000000001e-06 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777139+0000", 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0060772029999999998 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777245+0000", 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010563100000000001 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777381+0000", 2023-07-29T16:38:44.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000136181 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781766+0000", 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043856249999999998 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787515+0000", 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057486170000000001 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787571+0000", 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5600999999999998e-05 2023-07-29T16:38:44.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787618+0000", 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6947999999999998e-05 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:72483 5.1 e37/19 5:8f7b9819:::benchmark_data_smithi070_97781_object72482:head v 37'4598, mlcod=37'4595)", 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.042284571, 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016772616000000001, 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:44.210 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936874+0000", 2023-07-29T16:38:44.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936914+0000", 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9400000000000002e-05 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936925+0000", 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1121000000000001e-05 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936930+0000", 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3380000000000004e-06 2023-07-29T16:38:44.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936963+0000", 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2561000000000002e-05 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936978+0000", 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5191000000000001e-05 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.953610+0000", 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016631594999999999 2023-07-29T16:38:44.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.953648+0000", 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8084999999999999e-05 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:44.218 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:44.218 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:44.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:44.220 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 28 16 72755 72739 162.35 128.875 0.00327324 0.00615677 2023-07-29T16:38:44.220 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:44.217+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:44.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:44.320 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:44.318+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:44.366 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:44.388 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:44.400 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:44.400 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:44.409 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:44.410 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:44.410 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:44.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:44.457 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:44.455+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:44.523 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:44.520+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:44.542 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:38:44.586 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:44.586 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:44.601 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:44.624 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:44.621+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:44.726 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:44.723+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:44.813 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:44.813 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:44.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:44.867 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:44.865+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:44.928 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:44.926+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:44.998 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:44.998 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:45.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:45.054 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.052+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 29 16 74861 74845 161.29 131.625 0.0106928 0.0061974 2023-07-29T16:38:45.129 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.126+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.180 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:45.180 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:45.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:45.234 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.232+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.330 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.327+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.403 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:45.404 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:45.418 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:45.430 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:45.429+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:45.532 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.529+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.604 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:45.604 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:45.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:45.632 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.630+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.733 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:45.730+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:45.809 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:45.809 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:45.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:45.834 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.831+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:45.934 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:45.932+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:46.035 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:46.032+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:46.049 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:46.049 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:46.065 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:46.076 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 30 16 76882 76866 160.124 126.312 0.0148608 0.00624225 2023-07-29T16:38:46.136 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:46.133+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:46.234 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:46.234 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:46.238 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:46.235+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:46.249 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:46.339 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:46.336+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:46.419 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:46.420 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:46.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:46.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:46.439 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:46.437+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:46.540 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:46.538+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:46.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:38:46.573 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:46.598 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:46.610 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657929111999998, 2023-07-29T16:38:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657628127000002, 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657595372999999, 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657564491999999, 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657543122, 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018535998000000001, 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947697+0000", 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947696+0000", 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947699+0000", 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1480000000000002e-06 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947712+0000", 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2935000000000001e-05 2023-07-29T16:38:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947718+0000", 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948244+0000", 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052566799999999997 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948252+0000", 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2900000000000002e-06 2023-07-29T16:38:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956381+0000", 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081295159999999998 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956825+0000", 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000443394 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.956948+0000", 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012359099999999999 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960858+0000", 2023-07-29T16:38:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039096260000000002 2023-07-29T16:38:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966145+0000", 2023-07-29T16:38:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052871180000000004 2023-07-29T16:38:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966197+0000", 2023-07-29T16:38:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1649e-05 2023-07-29T16:38:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966233+0000", 2023-07-29T16:38:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5751999999999999e-05 2023-07-29T16:38:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657508675999999, 2023-07-29T16:38:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018621005, 2023-07-29T16:38:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947731+0000", 2023-07-29T16:38:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947734+0000", 2023-07-29T16:38:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:38:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947740+0000", 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947747+0000", 2023-07-29T16:38:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5459999999999997e-06 2023-07-29T16:38:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948395+0000", 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064788200000000002 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948402+0000", 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.957550+0000", 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091478889999999993 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958080+0000", 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052988700000000004 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.958542+0000", 2023-07-29T16:38:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046195299999999997 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962054+0000", 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035123200000000002 2023-07-29T16:38:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966271+0000", 2023-07-29T16:38:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042172290000000003 2023-07-29T16:38:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966316+0000", 2023-07-29T16:38:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4342999999999999e-05 2023-07-29T16:38:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966352+0000", 2023-07-29T16:38:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6223999999999997e-05 2023-07-29T16:38:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657486999, 2023-07-29T16:38:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.657008621000003, 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017979575000000001, 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948231+0000", 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948230+0000", 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948236+0000", 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948248+0000", 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2029e-05 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948258+0000", 2023-07-29T16:38:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949695+0000", 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014369210000000001 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.949702+0000", 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5170000000000002e-06 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953731+0000", 2023-07-29T16:38:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040286300000000001 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.953839+0000", 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108224 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966211+0000", 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012371741 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:27882 5.e 5:70dd6f80:::benchmark_data_smithi070_97781_object27881:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.08992134, 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015633725000000001, 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 27882 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515318+0000", 2023-07-29T16:38:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515317+0000", 2023-07-29T16:38:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515415+0000", 2023-07-29T16:38:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8084999999999993e-05 2023-07-29T16:38:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515427+0000", 2023-07-29T16:38:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1364e-05 2023-07-29T16:38:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515435+0000", 2023-07-29T16:38:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2023-07-29T16:38:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515482+0000", 2023-07-29T16:38:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6621e-05 2023-07-29T16:38:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515614+0000", 2023-07-29T16:38:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013204800000000001 2023-07-29T16:38:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.515750+0000", 2023-07-29T16:38:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013644500000000001 2023-07-29T16:38:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.520135+0000", 2023-07-29T16:38:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043848230000000004 2023-07-29T16:38:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530890+0000", 2023-07-29T16:38:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010755229999999999 2023-07-29T16:38:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530927+0000", 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6149000000000002e-05 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.530952+0000", 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5488000000000001e-05 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:28594 5.b 5:d9f8dc8d:::benchmark_data_smithi070_97781_object28593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.803450916999999, 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016113267000000001, 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28594 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801789+0000", 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801788+0000", 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801827+0000", 2023-07-29T16:38:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8825999999999997e-05 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801833+0000", 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.801837+0000", 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7730000000000001e-06 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804678+0000", 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028408959999999999 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804828+0000", 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149407 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.804951+0000", 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123521 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.813474+0000", 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085226639999999992 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817801+0000", 2023-07-29T16:38:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043273080000000002 2023-07-29T16:38:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817868+0000", 2023-07-29T16:38:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7007000000000004e-05 2023-07-29T16:38:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:24.817902+0000", 2023-07-29T16:38:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3963e-05 2023-07-29T16:38:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:39119 5.b 5:d24c1e56:::benchmark_data_smithi070_97781_object39118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.576648460000001, 2023-07-29T16:38:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015792800999999999, 2023-07-29T16:38:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 39119 2023-07-29T16:38:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028591+0000", 2023-07-29T16:38:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028631+0000", 2023-07-29T16:38:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0861000000000001e-05 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028657+0000", 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5624999999999999e-05 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.028671+0000", 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030170+0000", 2023-07-29T16:38:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014990820000000001 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030302+0000", 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013176900000000001 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.030437+0000", 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013460600000000001 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.032638+0000", 2023-07-29T16:38:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022014700000000001 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044293+0000", 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011655341 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044343+0000", 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0065000000000003e-05 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:29.044384+0000", 2023-07-29T16:38:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0528999999999998e-05 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:59315 5.4 5:26dd69f8:::benchmark_data_smithi070_97781_object59314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8615802850000005, 2023-07-29T16:38:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016419021999999998, 2023-07-29T16:38:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 59315 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743659+0000", 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743688+0000", 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9192000000000001e-05 2023-07-29T16:38:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743695+0000", 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1770000000000001e-06 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.743702+0000", 2023-07-29T16:38:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1760000000000004e-06 2023-07-29T16:38:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750657+0000", 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069546260000000002 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750749+0000", 2023-07-29T16:38:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2001000000000002e-05 2023-07-29T16:38:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.750839+0000", 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0304999999999997e-05 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.754808+0000", 2023-07-29T16:38:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039689149999999999 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.759982+0000", 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051734650000000004 2023-07-29T16:38:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760037+0000", 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5739999999999998e-05 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:37.760078+0000", 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1056999999999997e-05 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:60083 5.0 5:0130d468:::benchmark_data_smithi070_97781_object60082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5069360209999996, 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016688729999999999, 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 60083 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098304+0000", 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098303+0000", 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098356+0000", 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3090999999999997e-05 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098380+0000", 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4309000000000001e-05 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.098387+0000", 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3500000000000002e-06 2023-07-29T16:38:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103602+0000", 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052149989999999997 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103722+0000", 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119986 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.103853+0000", 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013117900000000001 2023-07-29T16:38:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.107161+0000", 2023-07-29T16:38:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033084910000000002 2023-07-29T16:38:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114913+0000", 2023-07-29T16:38:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077511280000000004 2023-07-29T16:38:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114954+0000", 2023-07-29T16:38:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1559e-05 2023-07-29T16:38:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.114992+0000", 2023-07-29T16:38:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8207000000000002e-05 2023-07-29T16:38:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61556 5.0 5:08bd3317:::benchmark_data_smithi070_97781_object61555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8220023740000002, 2023-07-29T16:38:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017549391000000001, 2023-07-29T16:38:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61556 2023-07-29T16:38:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783237+0000", 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783324+0000", 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7179e-05 2023-07-29T16:38:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783333+0000", 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3989999999999993e-06 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783341+0000", 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.559e-06 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786440+0000", 2023-07-29T16:38:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030994249999999998 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786528+0000", 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8051000000000001e-05 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.786612+0000", 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3523000000000007e-05 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.793067+0000", 2023-07-29T16:38:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064551909999999999 2023-07-29T16:38:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800708+0000", 2023-07-29T16:38:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007640829 2023-07-29T16:38:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800752+0000", 2023-07-29T16:38:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3937999999999998e-05 2023-07-29T16:38:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800787+0000", 2023-07-29T16:38:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5012000000000003e-05 2023-07-29T16:38:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61557 5.0 5:0a5a1aa5:::benchmark_data_smithi070_97781_object61556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8213685479999997, 2023-07-29T16:38:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017588416999999999, 2023-07-29T16:38:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61557 2023-07-29T16:38:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783871+0000", 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783870+0000", 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783938+0000", 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7959000000000004e-05 2023-07-29T16:38:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783947+0000", 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2800000000000003e-06 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.783956+0000", 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2760000000000006e-06 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788070+0000", 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041141149999999998 2023-07-29T16:38:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788209+0000", 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013932199999999999 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.788345+0000", 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135919 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.793772+0000", 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054271720000000001 2023-07-29T16:38:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801387+0000", 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076141869999999997 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801426+0000", 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9619999999999997e-05 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.801460+0000", 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3235999999999998e-05 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61559 5.8 5:1d4b7aba:::benchmark_data_smithi070_97781_object61558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8204710290000001, 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016043330000000001, 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61559 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784769+0000", 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784768+0000", 2023-07-29T16:38:46.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784895+0000", 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012731600000000001 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784905+0000", 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8810000000000008e-06 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.784913+0000", 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0819999999999999e-06 2023-07-29T16:38:46.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789657+0000", 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047439099999999996 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789732+0000", 2023-07-29T16:38:46.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5139e-05 2023-07-29T16:38:46.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.789811+0000", 2023-07-29T16:38:46.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8141999999999998e-05 2023-07-29T16:38:46.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796577+0000", 2023-07-29T16:38:46.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067661589999999999 2023-07-29T16:38:46.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800742+0000", 2023-07-29T16:38:46.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041655520000000003 2023-07-29T16:38:46.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800785+0000", 2023-07-29T16:38:46.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2403e-05 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.800812+0000", 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7263e-05 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.830 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61571 5.0 5:03d28ec5:::benchmark_data_smithi070_97781_object61570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8141245110000002, 2023-07-29T16:38:46.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016130768, 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61571 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791115+0000", 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791114+0000", 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791174+0000", 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9293999999999998e-05 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791190+0000", 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6311999999999999e-05 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791201+0000", 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1358e-05 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791241+0000", 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9863000000000001e-05 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791365+0000", 2023-07-29T16:38:46.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012344799999999999 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791490+0000", 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124912 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796632+0000", 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051424649999999997 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807150+0000", 2023-07-29T16:38:46.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010517548999999999 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807204+0000", 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4191999999999999e-05 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807246+0000", 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2073000000000002e-05 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.841 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:61572 5.8 5:192310c5:::benchmark_data_smithi070_97781_object61571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.8140154089999996, 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016021662999999998, 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 61572 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:46.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791224+0000", 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791211+0000", 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999871 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791262+0000", 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1143000000000001e-05 2023-07-29T16:38:46.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791268+0000", 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791273+0000", 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7709999999999997e-06 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791356+0000", 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3805000000000001e-05 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791442+0000", 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5711000000000007e-05 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.791530+0000", 2023-07-29T16:38:46.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8279e-05 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.796620+0000", 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050891139999999996 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807135+0000", 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010515678000000001 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807202+0000", 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7039999999999995e-05 2023-07-29T16:38:46.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:38.807246+0000", 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3637000000000003e-05 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:69139 5.4 5:2278aba4:::benchmark_data_smithi070_97781_object69138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:42.346828+0000", 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2584114749999999, 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016086310999999999, 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69139 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346828+0000", 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346828+0000", 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346828+0000", 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346851+0000", 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3070000000000001e-05 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346856+0000", 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7400000000000004e-06 2023-07-29T16:38:46.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.346859+0000", 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0149999999999999e-06 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.348568+0000", 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017089259999999999 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.348660+0000", 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2740999999999999e-05 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.348761+0000", 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100806 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.353878+0000", 2023-07-29T16:38:46.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051172550000000002 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.362838+0000", 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089594029999999995 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.362880+0000", 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2372e-05 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.362914+0000", 2023-07-29T16:38:46.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4381000000000002e-05 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:69595 5.d 5:ba69194d:::benchmark_data_smithi070_97781_object69594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:42.558555+0000", 2023-07-29T16:38:46.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0466847110000002, 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016139965999999999, 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69595 2023-07-29T16:38:46.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558555+0000", 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558555+0000", 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558554+0000", 2023-07-29T16:38:46.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558618+0000", 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3312000000000006e-05 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558624+0000", 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1940000000000003e-06 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558628+0000", 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0740000000000003e-06 2023-07-29T16:38:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558670+0000", 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2206000000000002e-05 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:46.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558782+0000", 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011195400000000001 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.558913+0000", 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013081799999999999 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.564211+0000", 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052984149999999999 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:46.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.574585+0000", 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010373736 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.574641+0000", 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5954e-05 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:46.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:42.574695+0000", 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3959999999999998e-05 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:46.872 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:46.873 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:46.874 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:46.874 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:46.871+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:46.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:46.975 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:46.973+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:47.054 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:78937 5.9 5:92a55071:::benchmark_data_smithi070_97781_object78936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.050313+0000", 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001768611, 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017955709999999999, 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 78937 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050313+0000", 2023-07-29T16:38:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050313+0000", 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050312+0000", 2023-07-29T16:38:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050403+0000", 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1019000000000004e-05 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050418+0000", 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4623999999999999e-05 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050428+0000", 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0266e-05 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050465+0000", 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7564999999999997e-05 2023-07-29T16:38:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050549+0000", 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3990000000000001e-05 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050631+0000", 2023-07-29T16:38:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1555000000000001e-05 2023-07-29T16:38:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:78939 5.2 5:4b83a017:::benchmark_data_smithi070_97781_object78938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.050440+0000", 2023-07-29T16:38:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001642012, 2023-07-29T16:38:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017504129999999999, 2023-07-29T16:38:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 78939 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050440+0000", 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050440+0000", 2023-07-29T16:38:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050439+0000", 2023-07-29T16:38:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050471+0000", 2023-07-29T16:38:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.269e-05 2023-07-29T16:38:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050480+0000", 2023-07-29T16:38:47.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6279999999999994e-06 2023-07-29T16:38:47.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050486+0000", 2023-07-29T16:38:47.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9630000000000003e-06 2023-07-29T16:38:47.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050531+0000", 2023-07-29T16:38:47.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4926999999999999e-05 2023-07-29T16:38:47.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050651+0000", 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000120436 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050791+0000", 2023-07-29T16:38:47.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000139942 2023-07-29T16:38:47.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:78938 5.6 e38/19 5:68d2c08f:::benchmark_data_smithi070_97781_object78937:head v 38'4834, mlcod=38'4832)", 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.050773+0000", 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001308184, 2023-07-29T16:38:47.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014897720000000001, 2023-07-29T16:38:47.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.079 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:47.079 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050773+0000", 2023-07-29T16:38:47.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050773+0000", 2023-07-29T16:38:47.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050773+0000", 2023-07-29T16:38:47.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050863+0000", 2023-07-29T16:38:47.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0236999999999997e-05 2023-07-29T16:38:47.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050872+0000", 2023-07-29T16:38:47.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0259999999999996e-06 2023-07-29T16:38:47.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050879+0000", 2023-07-29T16:38:47.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4919999999999998e-06 2023-07-29T16:38:47.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050913+0000", 2023-07-29T16:38:47.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4091999999999998e-05 2023-07-29T16:38:47.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050927+0000", 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4048e-05 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:78940 5.3 e38/19 5:ce71dbbf:::benchmark_data_smithi070_97781_object78939:head v 38'4939, mlcod=38'4937)", 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.051038+0000", 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0010437459999999999, 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001292147, 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:47.090 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051038+0000", 2023-07-29T16:38:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051038+0000", 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051037+0000", 2023-07-29T16:38:47.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051100+0000", 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2589000000000007e-05 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051110+0000", 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0519e-05 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051116+0000", 2023-07-29T16:38:47.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9970000000000004e-06 2023-07-29T16:38:47.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051159+0000", 2023-07-29T16:38:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2324000000000003e-05 2023-07-29T16:38:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051180+0000", 2023-07-29T16:38:47.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1403000000000002e-05 2023-07-29T16:38:47.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:78931 5.f 5:fcc1f191:::benchmark_data_smithi070_97781_object78930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.047418+0000", 2023-07-29T16:38:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0046640329999999997, 2023-07-29T16:38:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004982177, 2023-07-29T16:38:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.100 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.101 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 78931 2023-07-29T16:38:47.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.101 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047418+0000", 2023-07-29T16:38:47.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047418+0000", 2023-07-29T16:38:47.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047417+0000", 2023-07-29T16:38:47.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047443+0000", 2023-07-29T16:38:47.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5842000000000001e-05 2023-07-29T16:38:47.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047455+0000", 2023-07-29T16:38:47.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2167999999999999e-05 2023-07-29T16:38:47.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047461+0000", 2023-07-29T16:38:47.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0700000000000003e-06 2023-07-29T16:38:47.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047512+0000", 2023-07-29T16:38:47.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0840000000000001e-05 2023-07-29T16:38:47.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047658+0000", 2023-07-29T16:38:47.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014670800000000001 2023-07-29T16:38:47.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.047818+0000", 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015977499999999999 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.050403+0000", 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025850980000000001 2023-07-29T16:38:47.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:78932 5.1 5:8f114229:::benchmark_data_smithi070_97781_object78931:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:47.048398+0000", 2023-07-29T16:38:47.112 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0036838119999999999, 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040891299999999998, 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.113 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 78932 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048398+0000", 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048398+0000", 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048397+0000", 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048467+0000", 2023-07-29T16:38:47.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9529999999999993e-05 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048475+0000", 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2619999999999998e-06 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048480+0000", 2023-07-29T16:38:47.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7500000000000003e-06 2023-07-29T16:38:47.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048528+0000", 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8136000000000001e-05 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048653+0000", 2023-07-29T16:38:47.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012463099999999999 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.048738+0000", 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5643999999999995e-05 2023-07-29T16:38:47.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:47.051890+0000", 2023-07-29T16:38:47.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00315227 2023-07-29T16:38:47.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 6 2023-07-29T16:38:47.122 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:47.123 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 31 16 78993 78977 159.215 131.938 0.00284587 0.0062779 2023-07-29T16:38:47.124 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:47.121+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:47.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:47.225 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:47.223+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:47.298 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:47.299 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:47.299 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:47.299 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:47.300 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:47.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:47.327 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:47.324+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:47.429 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:47.426+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:47.480 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:47.481 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 64.955583669999996, 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.482 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:47.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:47.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:47.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:47.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.494 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530626689000002, 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:47.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:47.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:47.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530601834000002, 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.507 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:47.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:47.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:47.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530569890000002, 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.519 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:47.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:47.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:47.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:47.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530548279000001, 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.531 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:47.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:47.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:47.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530524219, 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:47.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:47.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530489070999998, 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:47.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:47.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530428053999998, 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:47.567 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:47.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:47.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:47.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:47.578 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:47.579 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530305763999998, 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:47.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:47.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:47.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:47.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.588 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:38:47.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:47.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:47.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:47.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530229302000002, 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.594 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:47.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:47.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:47.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:47.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530181718000001, 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.606 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:47.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:47.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:47.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:47.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.617 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.530158432, 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.618 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:47.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:47.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.626 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:59921 5.7 5:ecfeab76:::benchmark_data_smithi070_97781_object59920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.4542469429999993, 2023-07-29T16:38:47.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018023232, 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 59921 2023-07-29T16:38:47.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022845+0000", 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1282000000000001e-05 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022851+0000", 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022854+0000", 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.506e-06 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027040+0000", 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041851910000000004 2023-07-29T16:38:47.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027131+0000", 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1481e-05 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027224+0000", 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2925999999999998e-05 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.035723+0000", 2023-07-29T16:38:47.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0084984220000000003 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040758+0000", 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050352360000000002 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040808+0000", 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0466000000000001e-05 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040848+0000", 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9511999999999997e-05 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61411 5.f 5:f97c8622:::benchmark_data_smithi070_97781_object61410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:47.638 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.7646128809999997, 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018542692, 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61411 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:47.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712458+0000", 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712525+0000", 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6715000000000001e-05 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712534+0000", 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2920000000000001e-06 2023-07-29T16:38:47.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712541+0000", 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712589+0000", 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8489999999999998e-05 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712724+0000", 2023-07-29T16:38:47.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134208 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712894+0000", 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170471 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727900+0000", 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015006143 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730936+0000", 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030355849999999999 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730971+0000", 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:47.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731001+0000", 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0267999999999999e-05 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61419 5.f 5:f0534ab8:::benchmark_data_smithi070_97781_object61418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.7592600209999993, 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018012489999999999, 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61419 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717842+0000", 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0868000000000003e-05 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717850+0000", 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3080000000000008e-06 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717857+0000", 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3790000000000003e-06 2023-07-29T16:38:47.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.724902+0000", 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070455149999999996 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725049+0000", 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014657400000000001 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725202+0000", 2023-07-29T16:38:47.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015374400000000001 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731053+0000", 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058501719999999998 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735779+0000", 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047264890000000004 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735806+0000", 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7440000000000002e-05 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735824+0000", 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7438000000000001e-05 2023-07-29T16:38:47.660 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61420 5.7 5:ef4ebe24:::benchmark_data_smithi070_97781_object61419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:47.661 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.7591156049999999, 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017443556999999998, 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.662 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61420 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717955+0000", 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718009+0000", 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3974000000000002e-05 2023-07-29T16:38:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718017+0000", 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2139999999999999e-06 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718022+0000", 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3449999999999996e-06 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727958+0000", 2023-07-29T16:38:47.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357100000000004 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728039+0000", 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1358000000000003e-05 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728132+0000", 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3552000000000001e-05 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735340+0000", 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.007207677 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735345+0000", 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4379999999999997e-06 2023-07-29T16:38:47.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735375+0000", 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0236e-05 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735399+0000", 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4544000000000001e-05 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.672 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:70327 5.7 5:e4aa3c7c:::benchmark_data_smithi070_97781_object70326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4.5720473679999998, 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.01835469, 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 70327 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905059+0000", 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.574e-05 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905068+0000", 2023-07-29T16:38:47.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4120000000000001e-06 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905073+0000", 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.587e-06 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907576+0000", 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025028630000000001 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907691+0000", 2023-07-29T16:38:47.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114881 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907833+0000", 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000142001 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.910312+0000", 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024790379999999998 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923329+0000", 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013016872000000001 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923357+0000", 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7940999999999999e-05 2023-07-29T16:38:47.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923379+0000", 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1769000000000001e-05 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:71769 5.1 5:86bd9826:::benchmark_data_smithi070_97781_object71768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.8859940800000001, 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018367557, 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.684 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 71769 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591174+0000", 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7323000000000003e-05 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591184+0000", 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6860000000000001e-06 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591191+0000", 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9659999999999999e-06 2023-07-29T16:38:47.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591221+0000", 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0049e-05 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591314+0000", 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3436999999999993e-05 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591407+0000", 2023-07-29T16:38:47.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2806999999999994e-05 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.593404+0000", 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001997197 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609387+0000", 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015983127999999999 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609419+0000", 2023-07-29T16:38:47.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1180999999999998e-05 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609445+0000", 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6358000000000001e-05 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.694 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:72170 5.1 5:87c3c7af:::benchmark_data_smithi070_97781_object72169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6919573369999998, 2023-07-29T16:38:47.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017890138, 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 72170 2023-07-29T16:38:47.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785170+0000", 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6066000000000002e-05 2023-07-29T16:38:47.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785176+0000", 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9989999999999997e-06 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785179+0000", 2023-07-29T16:38:47.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1889999999999999e-06 2023-07-29T16:38:47.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.787956+0000", 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027771829999999999 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.788050+0000", 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4112999999999998e-05 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.788146+0000", 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5383000000000005e-05 2023-07-29T16:38:47.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.791362+0000", 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003216507 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.802929+0000", 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011566481999999999 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.802971+0000", 2023-07-29T16:38:47.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2416999999999997e-05 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.803004+0000", 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3142999999999998e-05 2023-07-29T16:38:47.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:72483 5.1 5:8f7b9819:::benchmark_data_smithi070_97781_object72482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:47.707 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.5407134930000002, 2023-07-29T16:38:47.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017426855000000002, 2023-07-29T16:38:47.708 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:47.708 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:47.708 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 72483 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:47.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:47.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:47.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:47.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:47.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936352+0000", 2023-07-29T16:38:47.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999943 2023-07-29T16:38:47.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:47.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936413+0000", 2023-07-29T16:38:47.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0816000000000002e-05 2023-07-29T16:38:47.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:47.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936422+0000", 2023-07-29T16:38:47.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9199999999999993e-06 2023-07-29T16:38:47.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936427+0000", 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0350000000000001e-06 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:47.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936472+0000", 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4605999999999999e-05 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936603+0000", 2023-07-29T16:38:47.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013134999999999999 2023-07-29T16:38:47.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:47.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936765+0000", 2023-07-29T16:38:47.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016150299999999999 2023-07-29T16:38:47.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:47.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.944228+0000", 2023-07-29T16:38:47.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074634180000000003 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953737+0000", 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0095090179999999993 2023-07-29T16:38:47.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953763+0000", 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5936999999999999e-05 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:47.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953785+0000", 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1742e-05 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:47.722 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:47.722 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:47.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-07-29T16:38:47.723 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:47.585+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:47.725 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:47.723+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:47.825 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:47.823+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:47.914 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80741 5.3 5:c2a7699c:::benchmark_data_smithi070_97781_object80740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.907264+0000", 2023-07-29T16:38:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035606650000000002, 2023-07-29T16:38:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035817359999999999, 2023-07-29T16:38:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80741 2023-07-29T16:38:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907264+0000", 2023-07-29T16:38:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907264+0000", 2023-07-29T16:38:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907264+0000", 2023-07-29T16:38:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907296+0000", 2023-07-29T16:38:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2721000000000001e-05 2023-07-29T16:38:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907304+0000", 2023-07-29T16:38:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5650000000000004e-06 2023-07-29T16:38:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907310+0000", 2023-07-29T16:38:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0739999999999998e-06 2023-07-29T16:38:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907801+0000", 2023-07-29T16:38:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049140999999999996 2023-07-29T16:38:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907925+0000", 2023-07-29T16:38:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123237 2023-07-29T16:38:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908056+0000", 2023-07-29T16:38:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013128099999999999 2023-07-29T16:38:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910269+0000", 2023-07-29T16:38:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022134329999999999 2023-07-29T16:38:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80746 5.5 5:af317c64:::benchmark_data_smithi070_97781_object80745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.907742+0000", 2023-07-29T16:38:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0030824699999999999, 2023-07-29T16:38:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031721890000000002, 2023-07-29T16:38:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80746 2023-07-29T16:38:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907742+0000", 2023-07-29T16:38:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907742+0000", 2023-07-29T16:38:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907742+0000", 2023-07-29T16:38:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907769+0000", 2023-07-29T16:38:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7194000000000001e-05 2023-07-29T16:38:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907781+0000", 2023-07-29T16:38:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2391e-05 2023-07-29T16:38:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907789+0000", 2023-07-29T16:38:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3399999999999998e-06 2023-07-29T16:38:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.909122+0000", 2023-07-29T16:38:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001332288 2023-07-29T16:38:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.909208+0000", 2023-07-29T16:38:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6235000000000004e-05 2023-07-29T16:38:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.909328+0000", 2023-07-29T16:38:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119671 2023-07-29T16:38:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:80745 5.0 e39/19 5:0de6fdda:::benchmark_data_smithi070_97781_object80744:head v 39'5117, mlcod=39'5115)", 2023-07-29T16:38:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.907837+0000", 2023-07-29T16:38:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0029880100000000001, 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031393139999999998, 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907837+0000", 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907837+0000", 2023-07-29T16:38:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907836+0000", 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907907+0000", 2023-07-29T16:38:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0312e-05 2023-07-29T16:38:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907916+0000", 2023-07-29T16:38:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9080000000000001e-06 2023-07-29T16:38:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907922+0000", 2023-07-29T16:38:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6139999999999997e-06 2023-07-29T16:38:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908004+0000", 2023-07-29T16:38:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1454999999999999e-05 2023-07-29T16:38:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908022+0000", 2023-07-29T16:38:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8624999999999999e-05 2023-07-29T16:38:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:80744 5.1 e39/19 5:851edb3b:::benchmark_data_smithi070_97781_object80743:head v 39'5162, mlcod=39'5160)", 2023-07-29T16:38:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.907925+0000", 2023-07-29T16:38:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028995100000000001, 2023-07-29T16:38:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003087102, 2023-07-29T16:38:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907925+0000", 2023-07-29T16:38:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907925+0000", 2023-07-29T16:38:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907925+0000", 2023-07-29T16:38:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907973+0000", 2023-07-29T16:38:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7966999999999997e-05 2023-07-29T16:38:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907995+0000", 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2382e-05 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908003+0000", 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.328e-06 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908087+0000", 2023-07-29T16:38:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3944999999999997e-05 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.908107+0000", 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0497e-05 2023-07-29T16:38:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80747 5.a 5:52920741:::benchmark_data_smithi070_97781_object80746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.910280+0000", 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00054510699999999997, 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077057600000000003, 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80747 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910280+0000", 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910280+0000", 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910279+0000", 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910320+0000", 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1445e-05 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910333+0000", 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2850999999999999e-05 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910342+0000", 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000004e-06 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910377+0000", 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5348000000000001e-05 2023-07-29T16:38:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910469+0000", 2023-07-29T16:38:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1751999999999998e-05 2023-07-29T16:38:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910604+0000", 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013487500000000001 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:80748 5.e e39/19 5:70a6fae6:::benchmark_data_smithi070_97781_object80747:head v 39'4995, mlcod=39'4993)", 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.910364+0000", 2023-07-29T16:38:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00046100399999999999, 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00072778100000000004, 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910364+0000", 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910364+0000", 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910363+0000", 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910398+0000", 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4934999999999997e-05 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910406+0000", 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1720000000000007e-06 2023-07-29T16:38:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910413+0000", 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6220000000000003e-06 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910449+0000", 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5868000000000003e-05 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910461+0000", 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:80749 5.0 e39/19 5:0574b393:::benchmark_data_smithi070_97781_object80748:head v 39'5118, mlcod=39'5115)", 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.910434+0000", 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00039129799999999999, 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00069566599999999995, 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910434+0000", 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910434+0000", 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910433+0000", 2023-07-29T16:38:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910465+0000", 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1934000000000003e-05 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910474+0000", 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.551e-06 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910480+0000", 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0979999999999999e-06 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910515+0000", 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5621000000000003e-05 2023-07-29T16:38:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910533+0000", 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7538999999999999e-05 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80754 5.a 5.edd893a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.910690+0000", 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000134974, 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053487900000000004, 2023-07-29T16:38:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80754 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910690+0000", 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910690+0000", 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910689+0000", 2023-07-29T16:38:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910825+0000", 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013631799999999999 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910836+0000", 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0284e-05 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910844+0000", 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1790000000000008e-06 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80739 5.5 5:a13f3445:::benchmark_data_smithi070_97781_object80738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.907053+0000", 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0037723430000000001, 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042744489999999996, 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80739 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907053+0000", 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907053+0000", 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907052+0000", 2023-07-29T16:38:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907170+0000", 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118643 2023-07-29T16:38:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907178+0000", 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4789999999999999e-06 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907188+0000", 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0078000000000001e-05 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907235+0000", 2023-07-29T16:38:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7652999999999999e-05 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907365+0000", 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129085 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.907512+0000", 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014758699999999999 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.910943+0000", 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003430785 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-29T16:38:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 9 2023-07-29T16:38:48.022 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:48.023 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-07-29T16:38:48.024 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:48.020+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:48.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 32 16 81103 81087 158.36 131.875 0.00811784 0.0063122 2023-07-29T16:38:48.124 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:48.121+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:48.225 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:48.223+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:48.252 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2023-07-29T16:38:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2023-07-29T16:38:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2023-07-29T16:38:48.253 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:48.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-07-29T16:38:48.325 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:48.323+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:48.426 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:48.424+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:48.497 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-29T16:38:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2023-07-29T16:38:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40186 5.6 5:65b7fe91:::benchmark_data_smithi070_97781_object40185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.041206109000001, 2023-07-29T16:38:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016297306000000001, 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40186 2023-07-29T16:38:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451648+0000", 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451747+0000", 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8999999999999994e-05 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451754+0000", 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5209999999999997e-06 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.451760+0000", 2023-07-29T16:38:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.207e-06 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456331+0000", 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045710070000000002 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456465+0000", 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013328299999999999 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.456603+0000", 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013830400000000001 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.458529+0000", 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019264880000000001 2023-07-29T16:38:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467888+0000", 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093583360000000001 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467923+0000", 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5358000000000003e-05 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.467945+0000", 2023-07-29T16:38:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2354999999999999e-05 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40211 5.6 5:6c09c9f2:::benchmark_data_smithi070_97781_object40210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2023-07-29T16:38:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.033301867999999, 2023-07-29T16:38:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017039855999999999, 2023-07-29T16:38:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40211 2023-07-29T16:38:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459552+0000", 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459624+0000", 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1897999999999995e-05 2023-07-29T16:38:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459640+0000", 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6555e-05 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.459646+0000", 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6559999999999997e-06 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.464809+0000", 2023-07-29T16:38:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051632960000000004 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.464939+0000", 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013012200000000001 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.465048+0000", 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108528 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.471715+0000", 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066671489999999998 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476508+0000", 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047928490000000001 2023-07-29T16:38:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476554+0000", 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5976000000000002e-05 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476592+0000", 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8526999999999999e-05 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40239 5.a 5:525bfd5d:::benchmark_data_smithi070_97781_object40238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.017435227, 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017227665999999999, 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40239 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475419+0000", 2023-07-29T16:38:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475418+0000", 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475489+0000", 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1304999999999996e-05 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475498+0000", 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8300000000000002e-06 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475505+0000", 2023-07-29T16:38:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8379999999999996e-06 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475547+0000", 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1476000000000001e-05 2023-07-29T16:38:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.475554+0000", 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0859999999999996e-06 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486757+0000", 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011203516 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486871+0000", 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114267 2023-07-29T16:38:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486983+0000", 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111632 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.491381+0000", 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043974840000000001 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492539+0000", 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011581689999999999 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492595+0000", 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6039000000000003e-05 2023-07-29T16:38:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.492647+0000", 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1853e-05 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40242 5.c 5:39dd90c4:::benchmark_data_smithi070_97781_object40241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.015887773999999, 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016618859999999999, 2023-07-29T16:38:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40242 2023-07-29T16:38:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.476966+0000", 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477026+0000", 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0248000000000003e-05 2023-07-29T16:38:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477040+0000", 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4576000000000001e-05 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477046+0000", 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.203e-06 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477073+0000", 2023-07-29T16:38:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7018000000000001e-05 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477076+0000", 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.298e-06 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486902+0000", 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098260650000000001 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.486988+0000", 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5607999999999998e-05 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.487107+0000", 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011917 2023-07-29T16:38:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.490961+0000", 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038541640000000002 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493518+0000", 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002557064 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493550+0000", 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2123999999999999e-05 2023-07-29T16:38:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493585+0000", 2023-07-29T16:38:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5132000000000002e-05 2023-07-29T16:38:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.549 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:40243 5.c 5:336e13cb:::benchmark_data_smithi070_97781_object40242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.015787550999999, 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017036386000000001, 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 40243 2023-07-29T16:38:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477067+0000", 2023-07-29T16:38:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477066+0000", 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477150+0000", 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.331e-05 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477155+0000", 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2680000000000002e-06 2023-07-29T16:38:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477159+0000", 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8870000000000002e-06 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477202+0000", 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3089e-05 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.477208+0000", 2023-07-29T16:38:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488598+0000", 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011390002999999999 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488714+0000", 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115252 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.488860+0000", 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014592899999999999 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.493481+0000", 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046215989999999997 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494019+0000", 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053786399999999999 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494068+0000", 2023-07-29T16:38:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8686000000000001e-05 2023-07-29T16:38:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:29.494103+0000", 2023-07-29T16:38:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5385000000000001e-05 2023-07-29T16:38:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:42293 5.c 5:39bcdf78:::benchmark_data_smithi070_97781_object42292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.177498761999999, 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015464794, 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42293 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315355+0000", 2023-07-29T16:38:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315466+0000", 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111263 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315474+0000", 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2239999999999995e-06 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.315481+0000", 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8460000000000002e-06 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.320747+0000", 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052656810000000004 2023-07-29T16:38:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.320872+0000", 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012529199999999999 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.321022+0000", 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014948199999999999 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.323148+0000", 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021265210000000001 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330736+0000", 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075877870000000004 2023-07-29T16:38:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330784+0000", 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8121999999999998e-05 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.330820+0000", 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6167000000000001e-05 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:43152 5.5 5:a4632811:::benchmark_data_smithi070_97781_object43151:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.824387365, 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017897074999999998, 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43152 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668467+0000", 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668507+0000", 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423999999999998e-05 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668512+0000", 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.848e-06 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.668515+0000", 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3560000000000001e-06 2023-07-29T16:38:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670709+0000", 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021933600000000001 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670792+0000", 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3176999999999993e-05 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.670872+0000", 2023-07-29T16:38:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9820000000000005e-05 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.673062+0000", 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021906569999999999 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686276+0000", 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013213538 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686328+0000", 2023-07-29T16:38:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2352999999999998e-05 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:30.686364+0000", 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5877000000000002e-05 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:53385 5.6 5:69ca3f5d:::benchmark_data_smithi070_97781_object53384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.451553734000001, 2023-07-29T16:38:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01561713, 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 53385 2023-07-29T16:38:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041301+0000", 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041300+0000", 2023-07-29T16:38:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041376+0000", 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5660000000000004e-05 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041385+0000", 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3130000000000004e-06 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041390+0000", 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6280000000000004e-06 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041419+0000", 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9641e-05 2023-07-29T16:38:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041512+0000", 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3129999999999998e-05 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.041601+0000", 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8622000000000006e-05 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.049553+0000", 2023-07-29T16:38:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079518920000000003 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056824+0000", 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072715289999999997 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056875+0000", 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0492999999999999e-05 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:35.056918+0000", 2023-07-29T16:38:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2729999999999999e-05 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:61571 5.0 e35/19 5:03d28ec5:::benchmark_data_smithi070_97781_object61570:head v 35'3927, mlcod=35'3921)", 2023-07-29T16:38:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7013602569999993, 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0154626, 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791494+0000", 2023-07-29T16:38:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791493+0000", 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791564+0000", 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0561000000000004e-05 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791575+0000", 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0821e-05 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791581+0000", 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8459999999999996e-06 2023-07-29T16:38:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797165+0000", 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055846079999999996 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797186+0000", 2023-07-29T16:38:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0557e-05 2023-07-29T16:38:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806885+0000", 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096989339999999993 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806957+0000", 2023-07-29T16:38:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1802000000000001e-05 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:61572 5.8 e35/19 5:192310c5:::benchmark_data_smithi070_97781_object61571:head v 35'3845, mlcod=35'3842)", 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7012681090000008, 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015290132999999999, 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791586+0000", 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791619+0000", 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3003999999999998e-05 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791627+0000", 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2009999999999999e-06 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.791637+0000", 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5449999999999992e-06 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797155+0000", 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005518495 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.797200+0000", 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4669999999999998e-05 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806810+0000", 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.009610235 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:38.806876+0000", 2023-07-29T16:38:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6319e-05 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:69048 5.6 5:67bf39bc:::benchmark_data_smithi070_97781_object69047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.1876209360000001, 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015369555, 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69048 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305233+0000", 2023-07-29T16:38:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305341+0000", 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010850599999999999 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305350+0000", 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305356+0000", 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4920000000000001e-06 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305383+0000", 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7555e-05 2023-07-29T16:38:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305471+0000", 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7682000000000005e-05 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.305584+0000", 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011260300000000001 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.308699+0000", 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003115254 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320539+0000", 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011840499000000001 2023-07-29T16:38:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320577+0000", 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7348999999999998e-05 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.320603+0000", 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6018999999999999e-05 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:70154 5.6 5:6f3432b9:::benchmark_data_smithi070_97781_object70153:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6727204269999998, 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017493801, 2023-07-29T16:38:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 70154 2023-07-29T16:38:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820134+0000", 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820133+0000", 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820157+0000", 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3450000000000001e-05 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820162+0000", 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6919999999999999e-06 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.820167+0000", 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0239999999999997e-06 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822009+0000", 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018412649999999999 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822129+0000", 2023-07-29T16:38:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120337 2023-07-29T16:38:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.822248+0000", 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119028 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.824282+0000", 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020338690000000002 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837538+0000", 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013255805000000001 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837589+0000", 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1694999999999999e-05 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.837628+0000", 2023-07-29T16:38:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8124999999999998e-05 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:70317 5.3 5:c381f24c:::benchmark_data_smithi070_97781_object70316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.5899851969999999, 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016132971999999999, 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 70317 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902869+0000", 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902868+0000", 2023-07-29T16:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902896+0000", 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7044999999999999e-05 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902904+0000", 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0660000000000004e-06 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.902910+0000", 2023-07-29T16:38:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1079999999999998e-06 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906503+0000", 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003593518 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906650+0000", 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014653999999999999 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.906742+0000", 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2134999999999998e-05 2023-07-29T16:38:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.914586+0000", 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078445340000000002 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.918910+0000", 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043240539999999999 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.918954+0000", 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640999999999998e-05 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:42.919002+0000", 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7888e-05 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:71612 5.a 5:5e4476e9:::benchmark_data_smithi070_97781_object71611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9775909890000003, 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017276524000000001, 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71612 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515263+0000", 2023-07-29T16:38:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515315+0000", 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2842e-05 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515323+0000", 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3289999999999996e-06 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.515333+0000", 2023-07-29T16:38:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0111e-05 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524081+0000", 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087477189999999993 2023-07-29T16:38:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524179+0000", 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8077000000000003e-05 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.524277+0000", 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8461999999999993e-05 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.530362+0000", 2023-07-29T16:38:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00608532 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532453+0000", 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020906190000000002 2023-07-29T16:38:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532504+0000", 2023-07-29T16:38:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0995999999999998e-05 2023-07-29T16:38:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.532540+0000", 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5698000000000003e-05 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:72129 5.3 5:cd3fb223:::benchmark_data_smithi070_97781_object72128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.7278109349999999, 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016482598000000001, 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72129 2023-07-29T16:38:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765043+0000", 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765102+0000", 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8901999999999999e-05 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765112+0000", 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0597999999999999e-05 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.765119+0000", 2023-07-29T16:38:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9550000000000003e-06 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.768864+0000", 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037445159999999998 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.768982+0000", 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118625 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.769104+0000", 2023-07-29T16:38:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121273 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.774912+0000", 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058088230000000003 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781462+0000", 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065494170000000001 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781499+0000", 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7137e-05 2023-07-29T16:38:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781526+0000", 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6971e-05 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:72142 5.3 5:c0928b9a:::benchmark_data_smithi070_97781_object72141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.7218394679999998, 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016602832000000001, 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72142 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771015+0000", 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771014+0000", 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771045+0000", 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1677000000000002e-05 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771055+0000", 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3039999999999994e-06 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.771062+0000", 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1430000000000001e-06 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777139+0000", 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0060772029999999998 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777245+0000", 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010563100000000001 2023-07-29T16:38:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.777381+0000", 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000136181 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.781766+0000", 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043856249999999998 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787515+0000", 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057486170000000001 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787571+0000", 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5600999999999998e-05 2023-07-29T16:38:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.787618+0000", 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6947999999999998e-05 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:72483 5.1 e37/19 5:8f7b9819:::benchmark_data_smithi070_97781_object72482:head v 37'4598, mlcod=37'4595)", 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5559791670000003, 2023-07-29T16:38:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016772616000000001, 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936875+0000", 2023-07-29T16:38:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936874+0000", 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936914+0000", 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9400000000000002e-05 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936925+0000", 2023-07-29T16:38:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1121000000000001e-05 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936930+0000", 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3380000000000004e-06 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936963+0000", 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2561000000000002e-05 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.936978+0000", 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5191000000000001e-05 2023-07-29T16:38:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.953610+0000", 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016631594999999999 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:43.953648+0000", 2023-07-29T16:38:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8084999999999999e-05 2023-07-29T16:38:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:78346 5.6 5:6e58e1be:::benchmark_data_smithi070_97781_object78345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:46.763179+0000", 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.7296751239999999, 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01723589, 2023-07-29T16:38:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 78346 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763179+0000", 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763179+0000", 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763178+0000", 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763236+0000", 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7587999999999998e-05 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763244+0000", 2023-07-29T16:38:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4980000000000006e-06 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.763251+0000", 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8909999999999998e-06 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.768335+0000", 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050840249999999998 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.768460+0000", 2023-07-29T16:38:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012482500000000001 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.768615+0000", 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015496499999999999 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.773952+0000", 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053366669999999998 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.780281+0000", 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006329009 2023-07-29T16:38:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.780375+0000", 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4415999999999999e-05 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:46.780415+0000", 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9746000000000002e-05 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4749.0:80584 5.6 5:6cd7c43e:::benchmark_data_smithi070_97781_object80583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:47.828122+0000", 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.66473250100000003, 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015720923000000001, 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2023-07-29T16:38:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4749", 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80584 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828122+0000", 2023-07-29T16:38:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828122+0000", 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828121+0000", 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828169+0000", 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8188e-05 2023-07-29T16:38:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828176+0000", 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1450000000000002e-06 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.828182+0000", 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4530000000000001e-06 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.832560+0000", 2023-07-29T16:38:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043780420000000004 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.832666+0000", 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106424 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.832754+0000", 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7948000000000006e-05 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2023-07-29T16:38:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.840252+0000", 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007497872 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.843748+0000", 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034962140000000001 2023-07-29T16:38:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.843802+0000", 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3390000000000002e-05 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:47.843843+0000", 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0853999999999999e-05 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4749.0:81773 5.0 e39/19 5:0d60515a:::benchmark_data_smithi070_97781_object81772:head v 39'5183, mlcod=39'5181)", 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2023-07-29T16:38:48.406874+0000", 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.085980451999999999, 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015398214, 2023-07-29T16:38:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.406874+0000", 2023-07-29T16:38:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.406874+0000", 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2023-07-29T16:38:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.406873+0000", 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.407055+0000", 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018187100000000001 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.407062+0000", 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9840000000000004e-06 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.407067+0000", 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1939999999999997e-06 2023-07-29T16:38:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.407101+0000", 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3348e-05 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2023-07-29T16:38:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.407119+0000", 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7978e-05 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.422238+0000", 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015118846 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-29T16:38:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2023-07-29T16:38:48.422272+0000", 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4363999999999998e-05 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-29T16:38:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-29T16:38:48.724 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-29T16:38:48.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-07-29T16:38:48.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:38:48.725 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2023-07-29T16:38:48.725 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:38:48.725 INFO:teuthology.orchestra.console.smithi151:Power off 2023-07-29T16:38:48.725 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:38:48.738 INFO:tasks.ceph.osd.2.smithi151.stderr:2023-07-29T16:38:48.722+0000 7f6255cd4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 94716) UID: 0 2023-07-29T16:38:48.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:48.750 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-07-29T16:38:48.750 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:38:48.777 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:38:48.827 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:48.825+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:48.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:48.917 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:48.917 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:48.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:82816 5.b e39/19)", 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.910152+0000", 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041979069999999999, 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042119560000000002, 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910152+0000", 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910152+0000", 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910151+0000", 2023-07-29T16:38:48.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910156+0000", 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6700000000000002e-06 2023-07-29T16:38:48.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910168+0000", 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2198000000000001e-05 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910174+0000", 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3860000000000004e-06 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82836 5.e 5:7b24d830:::benchmark_data_smithi070_97781_object82835:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.910241+0000", 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041090450000000004, 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041614210000000002, 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.924 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82836 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910241+0000", 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910241+0000", 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910240+0000", 2023-07-29T16:38:48.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910298+0000", 2023-07-29T16:38:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8718999999999998e-05 2023-07-29T16:38:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910308+0000", 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7450000000000007e-06 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910315+0000", 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5130000000000002e-06 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910841+0000", 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052659899999999999 2023-07-29T16:38:48.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911000+0000", 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158758 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911180+0000", 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017996700000000001 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:82830 5.a e39/19 5:5c412b0a:::benchmark_data_smithi070_97781_object82829:head v 39'5087, mlcod=39'5083)", 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.910350+0000", 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039996370000000003, 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040966309999999999, 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910350+0000", 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910350+0000", 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910350+0000", 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910420+0000", 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0224999999999999e-05 2023-07-29T16:38:48.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910427+0000", 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4309999999999997e-06 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910433+0000", 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9370000000000001e-06 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910501+0000", 2023-07-29T16:38:48.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7596999999999997e-05 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910521+0000", 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0282999999999999e-05 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.940 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:82838 5.f e39/19 5:f8dab314:::benchmark_data_smithi070_97781_object82837:head v 39'5127, mlcod=39'5124)", 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.911802+0000", 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0025473140000000002, 2023-07-29T16:38:48.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002689529, 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911802+0000", 2023-07-29T16:38:48.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911802+0000", 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911802+0000", 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911848+0000", 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6745000000000001e-05 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911858+0000", 2023-07-29T16:38:48.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7240000000000004e-06 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911865+0000", 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0419999999999997e-06 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911903+0000", 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7863e-05 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:48.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.911921+0000", 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8173999999999999e-05 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.948 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:82819 5.b e39/19)", 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.912703+0000", 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0016466650000000001, 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001856931, 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912703+0000", 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912703+0000", 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912703+0000", 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912706+0000", 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.349e-06 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912713+0000", 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.652e-06 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912718+0000", 2023-07-29T16:38:48.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1259999999999997e-06 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:82832 5.e e39/19)", 2023-07-29T16:38:48.954 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.913018+0000", 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0013314170000000001, 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016040830000000001, 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913018+0000", 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913018+0000", 2023-07-29T16:38:48.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913018+0000", 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913020+0000", 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2120000000000002e-06 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913028+0000", 2023-07-29T16:38:48.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.157e-06 2023-07-29T16:38:48.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.913032+0000", 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3689999999999998e-06 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.960 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:82836 5.e e39/19)", 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.914490+0000", 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998593, 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015767600000000001, 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914490+0000", 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914490+0000", 2023-07-29T16:38:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914490+0000", 2023-07-29T16:38:48.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914494+0000", 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9280000000000003e-06 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914505+0000", 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0767e-05 2023-07-29T16:38:48.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914511+0000", 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.966 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:82821 5.b e39/19)", 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.914540+0000", 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998102, 2023-07-29T16:38:48.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135587, 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914540+0000", 2023-07-29T16:38:48.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914540+0000", 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914539+0000", 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914542+0000", 2023-07-29T16:38:48.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.897e-06 2023-07-29T16:38:48.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914551+0000", 2023-07-29T16:38:48.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0820000000000005e-06 2023-07-29T16:38:48.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.914558+0000", 2023-07-29T16:38:48.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:38:48.974 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.974 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.974 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82816 5.b 5:d7baf822:::benchmark_data_smithi070_97781_object82815:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.902112+0000", 2023-07-29T16:38:48.976 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.01223723, 2023-07-29T16:38:48.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012596136000000001, 2023-07-29T16:38:48.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:48.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:48.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:48.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.978 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82816 2023-07-29T16:38:48.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.978 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902112+0000", 2023-07-29T16:38:48.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902112+0000", 2023-07-29T16:38:48.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902112+0000", 2023-07-29T16:38:48.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:48.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902155+0000", 2023-07-29T16:38:48.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3458000000000003e-05 2023-07-29T16:38:48.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902161+0000", 2023-07-29T16:38:48.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2570000000000004e-06 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.902165+0000", 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9319999999999998e-06 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904539+0000", 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023735549999999998 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:48.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904679+0000", 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013986900000000001 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904817+0000", 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138119 2023-07-29T16:38:48.987 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82819 5.b 5:d542ca20:::benchmark_data_smithi070_97781_object82818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.903206+0000", 2023-07-29T16:38:48.988 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011143704000000001, 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011567305999999999, 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:48.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82819 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903206+0000", 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903206+0000", 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903205+0000", 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903277+0000", 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2206999999999995e-05 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903288+0000", 2023-07-29T16:38:48.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0764000000000001e-05 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903295+0000", 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5690000000000001e-06 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.906856+0000", 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003561762 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.906942+0000", 2023-07-29T16:38:48.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5014999999999998e-05 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.907058+0000", 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116521 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.996 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82821 5.b 5:d968dbfa:::benchmark_data_smithi070_97781_object82820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.903322+0000", 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011027652000000001, 2023-07-29T16:38:48.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011520855, 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82821 2023-07-29T16:38:48.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903322+0000", 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:48.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903322+0000", 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:49.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903321+0000", 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903394+0000", 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2992999999999997e-05 2023-07-29T16:38:49.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903401+0000", 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1130000000000003e-06 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.903407+0000", 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4770000000000002e-06 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910138+0000", 2023-07-29T16:38:49.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067306040000000003 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910278+0000", 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014059200000000001 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.910414+0000", 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013633699999999999 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82826 5.b 5:dc35a527:::benchmark_data_smithi070_97781_object82825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.904777+0000", 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0095731129999999994, 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010153611, 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:49.006 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82826 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904777+0000", 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904777+0000", 2023-07-29T16:38:49.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904776+0000", 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904804+0000", 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8445e-05 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904814+0000", 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.679e-06 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.904822+0000", 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8159999999999994e-06 2023-07-29T16:38:49.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912105+0000", 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072836810000000002 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912349+0000", 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024394299999999999 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912502+0000", 2023-07-29T16:38:49.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153258 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82834 5.8 5:199bc079:::benchmark_data_smithi070_97781_object82833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:49.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.908724+0000", 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0056257879999999996, 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062777680000000004, 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:49.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82834 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908724+0000", 2023-07-29T16:38:49.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908724+0000", 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908723+0000", 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908783+0000", 2023-07-29T16:38:49.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9552000000000002e-05 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908799+0000", 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6895e-05 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908810+0000", 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0115000000000001e-05 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:49.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908850+0000", 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0844999999999999e-05 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.908986+0000", 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135869 2023-07-29T16:38:49.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.909128+0000", 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141762 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:49.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.912742+0000", 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036140769999999998 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:49.023 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:49.024 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 13 2023-07-29T16:38:49.024 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:49.025 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:49.026 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:49.023+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:49.026 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:49.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:49.067 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:49.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:49.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:49.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-07-29T16:38:49.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 33 16 83193 83177 157.519 130.625 0.00590178 0.00634563 2023-07-29T16:38:49.126 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:49.124+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:49.226 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.224+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:49.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:49.334 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:49.332+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:49.428 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.426+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:49.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:49.530 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.527+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:38:49.630 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.628+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.637 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:49.638 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:49.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:49.735 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.733+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.832 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.829+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:49.859 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:49.860 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:49.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:49.960 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:49.957+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:50.034 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:50.031+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:50.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 34 16 85319 85303 156.794 132.875 0.00888296 0.00637525 2023-07-29T16:38:50.088 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:50.089 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:50.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:50.147 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.145+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:50.235 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:50.232+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:50.275 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:50.275 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:50.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:50.373 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.371+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:50.437 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.435+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:50.494 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:50.494 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:50.508 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:50.538 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:50.536+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:50.554 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:38:50.639 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.638+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:50.708 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:50.709 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:50.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:50.765 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.763+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:50.840 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:50.838+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:50.897 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:50.897 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:50.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:50.941 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:50.940+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:51.042 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:51.041+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:51.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 35 16 87394 87378 156.02 129.688 0.00740236 0.00640693 2023-07-29T16:38:51.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:51.123 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:51.123 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:51.136 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:51.144 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:51.142+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:51.234 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:51.245 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:51.242+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:51.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:51.276 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2023-07-29T16:38:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-07-29T16:38:51.314 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.788455123000006, 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363498141999997, 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017990211999999998, 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946445+0000", 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946444+0000", 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946448+0000", 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7759999999999999e-06 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946456+0000", 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1270000000000003e-06 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946463+0000", 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5169999999999996e-06 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949338+0000", 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028755489999999998 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949343+0000", 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1279999999999999e-06 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954221+0000", 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048777079999999997 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954718+0000", 2023-07-29T16:38:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049660500000000001 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954869+0000", 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015169700000000001 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960203+0000", 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053338860000000004 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964322+0000", 2023-07-29T16:38:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041187860000000001 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964389+0000", 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7207999999999998e-05 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964435+0000", 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5745000000000003e-05 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363473286999998, 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363441342999998, 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363419731999997, 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363395672000003, 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363360524000001, 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:51.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363299507000001, 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017799992000000001, 2023-07-29T16:38:51.399 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946643+0000", 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946647+0000", 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.811e-06 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946659+0000", 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.252e-05 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946670+0000", 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0937999999999999e-05 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947316+0000", 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064568099999999995 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947320+0000", 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957948+0000", 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010627934 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958027+0000", 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9024999999999996e-05 2023-07-29T16:38:51.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958168+0000", 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141168 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961698+0000", 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035297039999999998 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964346+0000", 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026473600000000001 2023-07-29T16:38:51.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964403+0000", 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7006999999999998e-05 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964443+0000", 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0831999999999998e-05 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.410 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363177217, 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018427211999999998, 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946766+0000", 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946765+0000", 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946770+0000", 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6059999999999996e-06 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946777+0000", 2023-07-29T16:38:51.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2110000000000001e-06 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946784+0000", 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1099999999999997e-06 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947520+0000", 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073587000000000001 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947524+0000", 2023-07-29T16:38:51.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.464e-06 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958443+0000", 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010918535 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958551+0000", 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108412 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958675+0000", 2023-07-29T16:38:51.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000123342 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.963335+0000", 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046608070000000003 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965109+0000", 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001773798 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965157+0000", 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8315000000000001e-05 2023-07-29T16:38:51.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965193+0000", 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5408999999999999e-05 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.421 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363100754999998, 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:51.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:51.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.433 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363053170999997, 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017436857, 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946890+0000", 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946889+0000", 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946893+0000", 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.348e-06 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946900+0000", 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.875e-06 2023-07-29T16:38:51.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946906+0000", 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949780+0000", 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028743620000000001 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949787+0000", 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:38:51.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954217+0000", 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044295899999999997 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954359+0000", 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014203999999999999 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.954501+0000", 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014195200000000001 2023-07-29T16:38:51.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956849+0000", 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023486700000000002 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964233+0000", 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073833129999999999 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964286+0000", 2023-07-29T16:38:51.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3118999999999997e-05 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964327+0000", 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0898e-05 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.363029885000003, 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:51.445 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:51.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:51.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:51.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:59921 5.7 5:ecfeab76:::benchmark_data_smithi070_97781_object59920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 13.287118396, 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018023232, 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.454 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 59921 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022824+0000", 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022845+0000", 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1282000000000001e-05 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022851+0000", 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6389999999999997e-06 2023-07-29T16:38:51.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.022854+0000", 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.506e-06 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027040+0000", 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041851910000000004 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027131+0000", 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1481e-05 2023-07-29T16:38:51.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.027224+0000", 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2925999999999998e-05 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.035723+0000", 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0084984220000000003 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040758+0000", 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050352360000000002 2023-07-29T16:38:51.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040808+0000", 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0466000000000001e-05 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.040848+0000", 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9511999999999997e-05 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61411 5.f 5:f97c8622:::benchmark_data_smithi070_97781_object61410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.597484334000001, 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018542692, 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.465 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61411 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:51.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712458+0000", 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712525+0000", 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6715000000000001e-05 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712534+0000", 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2920000000000001e-06 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712541+0000", 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712589+0000", 2023-07-29T16:38:51.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8489999999999998e-05 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712724+0000", 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134208 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712894+0000", 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170471 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727900+0000", 2023-07-29T16:38:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015006143 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730936+0000", 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030355849999999999 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730971+0000", 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731001+0000", 2023-07-29T16:38:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0267999999999999e-05 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61419 5.f 5:f0534ab8:::benchmark_data_smithi070_97781_object61418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.592131474, 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018012489999999999, 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61419 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717811+0000", 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717842+0000", 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0868000000000003e-05 2023-07-29T16:38:51.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717850+0000", 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3080000000000008e-06 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717857+0000", 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3790000000000003e-06 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.724902+0000", 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070455149999999996 2023-07-29T16:38:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725049+0000", 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014657400000000001 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.725202+0000", 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015374400000000001 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731053+0000", 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0058501719999999998 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735779+0000", 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047264890000000004 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735806+0000", 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7440000000000002e-05 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735824+0000", 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7438000000000001e-05 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61420 5.7 5:ef4ebe24:::benchmark_data_smithi070_97781_object61419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.591987058000001, 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017443556999999998, 2023-07-29T16:38:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61420 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717956+0000", 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.717955+0000", 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718009+0000", 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3974000000000002e-05 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718017+0000", 2023-07-29T16:38:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2139999999999999e-06 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.718022+0000", 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3449999999999996e-06 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727958+0000", 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099357100000000004 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728039+0000", 2023-07-29T16:38:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1358000000000003e-05 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.728132+0000", 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3552000000000001e-05 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735340+0000", 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.007207677 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735345+0000", 2023-07-29T16:38:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4379999999999997e-06 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735375+0000", 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0236e-05 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.735399+0000", 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4544000000000001e-05 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:70327 5.7 5:e4aa3c7c:::benchmark_data_smithi070_97781_object70326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.4049188210000008, 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.01835469, 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 70327 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905024+0000", 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905059+0000", 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.574e-05 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905068+0000", 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4120000000000001e-06 2023-07-29T16:38:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.905073+0000", 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.587e-06 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907576+0000", 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025028630000000001 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907691+0000", 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114881 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.907833+0000", 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000142001 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.910312+0000", 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024790379999999998 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923329+0000", 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.013016872000000001 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923357+0000", 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7940999999999999e-05 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:42.923379+0000", 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1769000000000001e-05 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:71769 5.1 5:86bd9826:::benchmark_data_smithi070_97781_object71768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7188655329999998, 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018367557, 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 71769 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591077+0000", 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591174+0000", 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7323000000000003e-05 2023-07-29T16:38:51.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591184+0000", 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6860000000000001e-06 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591191+0000", 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9659999999999999e-06 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591221+0000", 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0049e-05 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591314+0000", 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3436999999999993e-05 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.591407+0000", 2023-07-29T16:38:51.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2806999999999994e-05 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.593404+0000", 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001997197 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609387+0000", 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015983127999999999 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609419+0000", 2023-07-29T16:38:51.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1180999999999998e-05 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.609445+0000", 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6358000000000001e-05 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:72170 5.1 5:87c3c7af:::benchmark_data_smithi070_97781_object72169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.5248287899999999, 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017890138, 2023-07-29T16:38:51.518 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 72170 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:51.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785114+0000", 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785170+0000", 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6066000000000002e-05 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785176+0000", 2023-07-29T16:38:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9989999999999997e-06 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.785179+0000", 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1889999999999999e-06 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.787956+0000", 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027771829999999999 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.788050+0000", 2023-07-29T16:38:51.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4112999999999998e-05 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.788146+0000", 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5383000000000005e-05 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.791362+0000", 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003216507 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.802929+0000", 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011566481999999999 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.802971+0000", 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2416999999999997e-05 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.803004+0000", 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3142999999999998e-05 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:72483 5.1 5:8f7b9819:::benchmark_data_smithi070_97781_object72482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.3735849460000003, 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017426855000000002, 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:51.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 72483 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:51.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936358+0000", 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:51.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936352+0000", 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999943 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936413+0000", 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0816000000000002e-05 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936422+0000", 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9199999999999993e-06 2023-07-29T16:38:51.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936427+0000", 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0350000000000001e-06 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:51.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936472+0000", 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4605999999999999e-05 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936603+0000", 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013134999999999999 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.936765+0000", 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016150299999999999 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:51.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.944228+0000", 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074634180000000003 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953737+0000", 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0095090179999999993 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953763+0000", 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5936999999999999e-05 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:43.953785+0000", 2023-07-29T16:38:51.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1742e-05 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:51.539 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:51.541 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:51.538+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:51.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:51.641 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:51.640+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:51.707 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88706 5.8 5:1cc32765:::benchmark_data_smithi070_97781_object88705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.698632+0000", 2023-07-29T16:38:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0068330209999999999, 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068604709999999999, 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88706 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698632+0000", 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698632+0000", 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698632+0000", 2023-07-29T16:38:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698683+0000", 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1842000000000003e-05 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698696+0000", 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2383e-05 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698706+0000", 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7059999999999999e-06 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.700236+0000", 2023-07-29T16:38:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001530085 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.700378+0000", 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014243 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.700514+0000", 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589799999999999 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704525+0000", 2023-07-29T16:38:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040108490000000004 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88707 5.b 5:da2ee325:::benchmark_data_smithi070_97781_object88706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.698872+0000", 2023-07-29T16:38:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0065932539999999998, 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067116559999999999, 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88707 2023-07-29T16:38:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698872+0000", 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698872+0000", 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698871+0000", 2023-07-29T16:38:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698930+0000", 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8492999999999997e-05 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698942+0000", 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1899000000000001e-05 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698950+0000", 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6929999999999996e-06 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.698994+0000", 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3624000000000001e-05 2023-07-29T16:38:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699131+0000", 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136623 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699269+0000", 2023-07-29T16:38:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013795300000000001 2023-07-29T16:38:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.703076+0000", 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038078460000000001 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88709 5.4 5:2bc9ab93:::benchmark_data_smithi070_97781_object88708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.699029+0000", 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0064365530000000002, 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006644535, 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88709 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699029+0000", 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699029+0000", 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699028+0000", 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699134+0000", 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105597 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699142+0000", 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6459999999999993e-06 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699148+0000", 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7730000000000002e-06 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699179+0000", 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0258000000000001e-05 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699252+0000", 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3150000000000003e-05 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699349+0000", 2023-07-29T16:38:51.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7398000000000005e-05 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.701727+0000", 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023780239999999998 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88711 5.b 5:d2f8efd4:::benchmark_data_smithi070_97781_object88710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.699249+0000", 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0062164480000000003, 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006508387, 2023-07-29T16:38:51.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88711 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699249+0000", 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699249+0000", 2023-07-29T16:38:51.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699248+0000", 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699332+0000", 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3560000000000006e-05 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699342+0000", 2023-07-29T16:38:51.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9799999999999993e-06 2023-07-29T16:38:51.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.699349+0000", 2023-07-29T16:38:51.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2439999999999996e-06 2023-07-29T16:38:51.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.701128+0000", 2023-07-29T16:38:51.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017790449999999999 2023-07-29T16:38:51.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.701260+0000", 2023-07-29T16:38:51.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013232200000000001 2023-07-29T16:38:51.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.701411+0000", 2023-07-29T16:38:51.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150457 2023-07-29T16:38:51.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704278+0000", 2023-07-29T16:38:51.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028676679999999999 2023-07-29T16:38:51.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88715 5.d 5:b9add5fc:::benchmark_data_smithi070_97781_object88714:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.702549+0000", 2023-07-29T16:38:51.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029163150000000001, 2023-07-29T16:38:51.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003290832, 2023-07-29T16:38:51.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.750 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.750 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.750 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.750 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88715 2023-07-29T16:38:51.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.751 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702549+0000", 2023-07-29T16:38:51.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702549+0000", 2023-07-29T16:38:51.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702548+0000", 2023-07-29T16:38:51.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:51.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702615+0000", 2023-07-29T16:38:51.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7210000000000002e-05 2023-07-29T16:38:51.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702625+0000", 2023-07-29T16:38:51.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7599999999999997e-06 2023-07-29T16:38:51.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702632+0000", 2023-07-29T16:38:51.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1919999999999999e-06 2023-07-29T16:38:51.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702687+0000", 2023-07-29T16:38:51.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4938000000000002e-05 2023-07-29T16:38:51.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702815+0000", 2023-07-29T16:38:51.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012830599999999999 2023-07-29T16:38:51.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702997+0000", 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018174099999999999 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.705108+0000", 2023-07-29T16:38:51.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021109789999999998 2023-07-29T16:38:51.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:88716 5.8 5:14a2a925:::benchmark_data_smithi070_97781_object88715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.702643+0000", 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028220820000000001, 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032785589999999999, 2023-07-29T16:38:51.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 88716 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702643+0000", 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702643+0000", 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702643+0000", 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702676+0000", 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2911999999999999e-05 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702684+0000", 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6109999999999994e-06 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702690+0000", 2023-07-29T16:38:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1789999999999996e-06 2023-07-29T16:38:51.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702862+0000", 2023-07-29T16:38:51.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017186299999999999 2023-07-29T16:38:51.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.702982+0000", 2023-07-29T16:38:51.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119302 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.703112+0000", 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130667 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.705095+0000", 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019825870000000001 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:88718 5.9 e40/19 5:92093f54:::benchmark_data_smithi070_97781_object88717:head v 40'5552, mlcod=40'5548)", 2023-07-29T16:38:51.775 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.704792+0000", 2023-07-29T16:38:51.775 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00067303999999999997, 2023-07-29T16:38:51.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012102460000000001, 2023-07-29T16:38:51.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:51.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704792+0000", 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704792+0000", 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704792+0000", 2023-07-29T16:38:51.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704899+0000", 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010746100000000001 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704910+0000", 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0399e-05 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704915+0000", 2023-07-29T16:38:51.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0590000000000002e-06 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704945+0000", 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0698999999999999e-05 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:51.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.704957+0000", 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1959e-05 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:51.782 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:51.782 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:38:51.782 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:51.783 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:51.780+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:51.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:51.883 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:51.881+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:51.984 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:51.982+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:51.984 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:51.985 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:51.985 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:51.985 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:51.985 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:52.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:52.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 36 16 89457 89441 155.267 128.938 0.00690039 0.00643747 2023-07-29T16:38:52.087 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:52.085+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:52.185 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:52.184+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:52.199 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.201 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.201 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:52.201 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.247519521000001, 2023-07-29T16:38:52.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:52.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.202 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:52.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:52.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:52.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:52.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:52.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:52.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:52.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:52.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:52.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.247218535999998, 2023-07-29T16:38:52.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:52.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:52.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:52.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:52.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:52.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:52.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:52.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:52.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:52.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.247185782000003, 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019034141000000001, 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.229 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947644+0000", 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947654+0000", 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7270000000000002e-06 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947661+0000", 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947668+0000", 2023-07-29T16:38:52.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3799999999999996e-06 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948461+0000", 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079248100000000004 2023-07-29T16:38:52.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948466+0000", 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7999999999999998e-06 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960000+0000", 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011534268 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960101+0000", 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101239 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960505+0000", 2023-07-29T16:38:52.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000403507 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962520+0000", 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020155049999999999 2023-07-29T16:38:52.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966577+0000", 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040569400000000002 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966636+0000", 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8717e-05 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966678+0000", 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2697000000000001e-05 2023-07-29T16:38:52.240 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.247154901000002, 2023-07-29T16:38:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019296193999999999, 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947675+0000", 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947678+0000", 2023-07-29T16:38:52.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.721e-06 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947685+0000", 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2480000000000001e-06 2023-07-29T16:38:52.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947692+0000", 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1010000000000003e-06 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948554+0000", 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086176999999999998 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948559+0000", 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1209999999999998e-06 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960875+0000", 2023-07-29T16:38:52.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012315919 2023-07-29T16:38:52.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960944+0000", 2023-07-29T16:38:52.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9475999999999997e-05 2023-07-29T16:38:52.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961037+0000", 2023-07-29T16:38:52.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3113000000000001e-05 2023-07-29T16:38:52.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962574+0000", 2023-07-29T16:38:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015372210000000001 2023-07-29T16:38:52.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966907+0000", 2023-07-29T16:38:52.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043323809999999997 2023-07-29T16:38:52.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966950+0000", 2023-07-29T16:38:52.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2769999999999999e-05 2023-07-29T16:38:52.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966971+0000", 2023-07-29T16:38:52.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1844999999999998e-05 2023-07-29T16:38:52.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.257 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.258 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.258 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:52.258 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.247077408000003, 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019435924, 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947753+0000", 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947752+0000", 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947756+0000", 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947853+0000", 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6700000000000006e-05 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948217+0000", 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036433 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948592+0000", 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037508499999999999 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948596+0000", 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1509999999999997e-06 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961951+0000", 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013354657000000001 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962076+0000", 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012478700000000001 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962211+0000", 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135298 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962981+0000", 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077015500000000001 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967113+0000", 2023-07-29T16:38:52.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041323389999999996 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967158+0000", 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4490999999999998e-05 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967189+0000", 2023-07-29T16:38:52.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.065e-05 2023-07-29T16:38:52.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:79750 5.d 5:be8bb69d:::benchmark_data_smithi070_97781_object79749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:52.270 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7632754249999998, 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019645072, 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 79750 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431554+0000", 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431671+0000", 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117586 2023-07-29T16:38:52.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431681+0000", 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2229999999999996e-06 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431686+0000", 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436387+0000", 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047008199999999997 2023-07-29T16:38:52.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436494+0000", 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106919 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436595+0000", 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100898 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.437788+0000", 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001193403 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451136+0000", 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013347835000000001 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451171+0000", 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5074999999999999e-05 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451200+0000", 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8413000000000001e-05 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.281 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:82744 5.0 5:0dd11f66:::benchmark_data_smithi070_97781_object82743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-07-29T16:38:52.282 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:48.867560+0000", 2023-07-29T16:38:52.282 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.327270247, 2023-07-29T16:38:52.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018724244000000001, 2023-07-29T16:38:52.282 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.282 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 82744 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867560+0000", 2023-07-29T16:38:52.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867560+0000", 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867559+0000", 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867620+0000", 2023-07-29T16:38:52.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0622999999999999e-05 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867631+0000", 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1234e-05 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.867637+0000", 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.511e-06 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.871549+0000", 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039120200000000004 2023-07-29T16:38:52.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.871678+0000", 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128453 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.871858+0000", 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179774 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.874229+0000", 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023713810000000001 2023-07-29T16:38:52.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.886167+0000", 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011938102000000001 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.886248+0000", 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0551999999999997e-05 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:48.886284+0000", 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6397999999999999e-05 2023-07-29T16:38:52.292 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89045 5.4 5:29d3db11:::benchmark_data_smithi070_97781_object89044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:51.857582+0000", 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.33724817899999998, 2023-07-29T16:38:52.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01889509, 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89045 2023-07-29T16:38:52.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857582+0000", 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857582+0000", 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857581+0000", 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857648+0000", 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6591e-05 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857655+0000", 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4710000000000001e-06 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.857660+0000", 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.498e-06 2023-07-29T16:38:52.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.858788+0000", 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011286650000000001 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.858934+0000", 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014518300000000001 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.859111+0000", 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017704 2023-07-29T16:38:52.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.862842+0000", 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037316129999999999 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.876396+0000", 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013553984999999999 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.876434+0000", 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7509999999999998e-05 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:51.876477+0000", 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3183000000000003e-05 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.14436960500000001, 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:38:52.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:38:52.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:38:52.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.144285775, 2023-07-29T16:38:52.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:38:52.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:38:52.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.14174281, 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:52.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:38:52.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:38:52.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:38:52.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.334 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.126982764, 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:38:52.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.336 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:38:52.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:38:52.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89451 5.4 5:2720ee21:::benchmark_data_smithi070_97781_object89450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.11999894899999999, 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020199971000000001, 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89451 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074830+0000", 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074904+0000", 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3059999999999995e-05 2023-07-29T16:38:52.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074913+0000", 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3190000000000001e-06 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074925+0000", 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2051e-05 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074962+0000", 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7358999999999999e-05 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.075082+0000", 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011948899999999999 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.075222+0000", 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000140221 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.077871+0000", 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026492849999999999 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.094939+0000", 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017068175000000001 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.094991+0000", 2023-07-29T16:38:52.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1362000000000001e-05 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095031+0000", 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0296999999999997e-05 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89476 5.0 5:0ddffb84:::benchmark_data_smithi070_97781_object89475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.099680242000000002, 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021368195, 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89476 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095149+0000", 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095356+0000", 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206844 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095362+0000", 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6110000000000001e-06 2023-07-29T16:38:52.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095366+0000", 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3100000000000002e-06 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3018999999999997e-05 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095493+0000", 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3429000000000003e-05 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095624+0000", 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013110800000000001 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.100791+0000", 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051678169999999999 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116459+0000", 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015667793999999999 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116495+0000", 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5410000000000001e-05 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116518+0000", 2023-07-29T16:38:52.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3339000000000001e-05 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:52.366 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.099456718, 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:38:52.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:52.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:38:52.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.099296914, 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:38:52.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:38:52.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:38:52.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:38:52.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:52.387 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.095169762000000005, 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:38:52.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:38:52.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:38:52.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.089522957, 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:52.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:38:52.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:38:52.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:38:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89534 5.0 5:0ce20406:::benchmark_data_smithi070_97781_object89533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.055198391999999999, 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020677213999999999, 2023-07-29T16:38:52.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89534 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139631+0000", 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139730+0000", 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9395000000000006e-05 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139743+0000", 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2388999999999999e-05 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139751+0000", 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1899999999999995e-06 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143810+0000", 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040596460000000001 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143920+0000", 2023-07-29T16:38:52.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109638 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.144004+0000", 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4307000000000004e-05 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.148076+0000", 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004071206 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160259+0000", 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012183131 2023-07-29T16:38:52.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160287+0000", 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8450999999999999e-05 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160309+0000", 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1716e-05 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.044533664000000001, 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:52.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:38:52.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:38:52.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:38:52.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:52.429 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:52.429 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:52.430 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:52.427+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:52.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:52.531 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:52.528+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:52.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:38:52.595 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:52.595 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:52.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.595 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90193 5.6 5.f3aba036 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.567668+0000", 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.025180276000000001, 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025195446, 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90193 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567668+0000", 2023-07-29T16:38:52.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567668+0000", 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567667+0000", 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999981 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567700+0000", 2023-07-29T16:38:52.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3772000000000001e-05 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567906+0000", 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020582599999999999 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567919+0000", 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.322e-05 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569469+0000", 2023-07-29T16:38:52.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001549468 2023-07-29T16:38:52.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569478+0000", 2023-07-29T16:38:52.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2609999999999999e-06 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90195 5.6 5.c7294316 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.603 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.567933+0000", 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.024915375999999999, 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024972477, 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90195 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567933+0000", 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567933+0000", 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567933+0000", 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567974+0000", 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1069000000000003e-05 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567983+0000", 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9269999999999994e-06 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567989+0000", 2023-07-29T16:38:52.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.567e-06 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569553+0000", 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015641030000000001 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569560+0000", 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0960000000000003e-06 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90199 5.6 5.99943696 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.567995+0000", 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.024853251999999999, 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024946132999999999, 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90199 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567995+0000", 2023-07-29T16:38:52.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567995+0000", 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567995+0000", 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568026+0000", 2023-07-29T16:38:52.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0661999999999999e-05 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568033+0000", 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.058e-06 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568038+0000", 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2800000000000003e-06 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569583+0000", 2023-07-29T16:38:52.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015448390000000001 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569589+0000", 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3509999999999998e-06 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.617 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90204 5.c 5.df02423c (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.568045+0000", 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.024803852000000001, 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024931449000000001, 2023-07-29T16:38:52.618 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90204 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568045+0000", 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568045+0000", 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568044+0000", 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568073+0000", 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8364000000000002e-05 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568079+0000", 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6749999999999996e-06 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568085+0000", 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2560000000000002e-06 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568335+0000", 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00025057999999999998 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568342+0000", 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1199999999999996e-06 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90212 5.6 5.f7879916 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.568224+0000", 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.024624496999999999, 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.024786631999999999, 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.626 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90212 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568224+0000", 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568224+0000", 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568224+0000", 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568251+0000", 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7798999999999999e-05 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568259+0000", 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9130000000000003e-06 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568266+0000", 2023-07-29T16:38:52.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8079999999999999e-06 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569610+0000", 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001344352 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.569617+0000", 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0939999999999996e-06 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90218 5.7 5.b0e36cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.572602+0000", 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.020246535, 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020442669, 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90218 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572602+0000", 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572602+0000", 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572601+0000", 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572649+0000", 2023-07-29T16:38:52.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7902999999999999e-05 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572661+0000", 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2619000000000001e-05 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572670+0000", 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0119999999999994e-06 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572710+0000", 2023-07-29T16:38:52.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9279000000000001e-05 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572718+0000", 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4840000000000004e-06 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.639 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90219 5.5 5.aea75805 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.572684+0000", 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.020164953999999999, 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020395146999999999, 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.640 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90219 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572684+0000", 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572684+0000", 2023-07-29T16:38:52.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572683+0000", 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572715+0000", 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1928000000000003e-05 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572723+0000", 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.559e-06 2023-07-29T16:38:52.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572730+0000", 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572766+0000", 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6548000000000003e-05 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572771+0000", 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8600000000000001e-06 2023-07-29T16:38:52.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90202 5.2 5:43b421b2:::benchmark_data_smithi070_97781_object90201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.551304+0000", 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.041544216000000002, 2023-07-29T16:38:52.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.041814285, 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90202 2023-07-29T16:38:52.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551304+0000", 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551304+0000", 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551304+0000", 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551438+0000", 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000133728 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551445+0000", 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2690000000000002e-06 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.551451+0000", 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5670000000000002e-06 2023-07-29T16:38:52.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553078+0000", 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0016272680000000001 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553196+0000", 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117828 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553303+0000", 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107738 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.558498+0000", 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051941419999999997 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567235+0000", 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.008737491 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567247+0000", 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1924e-05 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.656 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90208 5.2 5:4e114f69:::benchmark_data_smithi070_97781_object90207:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.553867+0000", 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.038982199000000002, 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.039303124000000002, 2023-07-29T16:38:52.657 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90208 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553867+0000", 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553867+0000", 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553866+0000", 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553894+0000", 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8513e-05 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553902+0000", 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.695e-06 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553908+0000", 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6670000000000001e-06 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.555221+0000", 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013134290000000001 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.555355+0000", 2023-07-29T16:38:52.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013405700000000001 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.555497+0000", 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014190900000000001 2023-07-29T16:38:52.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567281+0000", 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011783472 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.567288+0000", 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8180000000000004e-06 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.666 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90214 5.1 5:83252e7a:::benchmark_data_smithi070_97781_object90213:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.556910+0000", 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.035938445999999999, 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.036305173000000003, 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:52.667 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90214 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.556910+0000", 2023-07-29T16:38:52.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.556910+0000", 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.556910+0000", 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.557020+0000", 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110432 2023-07-29T16:38:52.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.557028+0000", 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0649999999999999e-06 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.557035+0000", 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2280000000000001e-06 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.558295+0000", 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001259895 2023-07-29T16:38:52.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.558432+0000", 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000136747 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:52.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.558586+0000", 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015363599999999999 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568172+0000", 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.009586308 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.568182+0000", 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0088999999999999e-05 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.675 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:52.676 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 10 2023-07-29T16:38:52.676 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:52.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:52.678 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:52.675+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:52.777 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:52.776+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:52.779 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:38:52.804 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:52.805 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:52.805 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:52.805 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:52.805 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:52.814 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:52.878 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:52.875+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:52.891 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:38:52.945 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:52.945 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:52.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:52.945 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.419819333000007, 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.946 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:52.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:52.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:52.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:52.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:52.958 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994837496999999, 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018638344000000001, 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:52.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946470+0000", 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946469+0000", 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946473+0000", 2023-07-29T16:38:52.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8489999999999999e-06 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946487+0000", 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4365000000000001e-05 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946494+0000", 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0110000000000003e-06 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949580+0000", 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030858130000000002 2023-07-29T16:38:52.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949586+0000", 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.071e-06 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.956954+0000", 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073676430000000001 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957036+0000", 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1890000000000004e-05 2023-07-29T16:38:52.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957122+0000", 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999995e-05 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:52.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960880+0000", 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037583069999999998 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965045+0000", 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041654279999999997 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965081+0000", 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5589000000000001e-05 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:52.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965108+0000", 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7059e-05 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.969 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994805552999999, 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018722177, 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946502+0000", 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946501+0000", 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946505+0000", 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946512+0000", 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4449999999999999e-06 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946518+0000", 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6609999999999997e-06 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949620+0000", 2023-07-29T16:38:52.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003102334 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949625+0000", 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1950000000000002e-06 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957434+0000", 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078084699999999996 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957577+0000", 2023-07-29T16:38:52.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014285099999999999 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.957986+0000", 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00040936 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960910+0000", 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002923714 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965148+0000", 2023-07-29T16:38:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0042381570000000002 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965191+0000", 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3247000000000001e-05 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965224+0000", 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2478000000000003e-05 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994783941999998, 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018880534000000001, 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.981 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946523+0000", 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946528+0000", 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9699999999999998e-06 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946535+0000", 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3989999999999998e-06 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946541+0000", 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9680000000000003e-06 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949654+0000", 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031127820000000001 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949659+0000", 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958403+0000", 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0087444719999999997 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958491+0000", 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7472000000000005e-05 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958620+0000", 2023-07-29T16:38:52.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012887099999999999 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.961893+0000", 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032736290000000001 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965312+0000", 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034191159999999998 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965367+0000", 2023-07-29T16:38:52.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4274999999999998e-05 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965404+0000", 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.693e-05 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:52.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994759881999997, 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018966486000000001, 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:52.992 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946547+0000", 2023-07-29T16:38:52.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946550+0000", 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946562+0000", 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1518999999999999e-05 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946575+0000", 2023-07-29T16:38:52.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3061000000000001e-05 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949693+0000", 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031177980000000002 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949697+0000", 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7419999999999999e-06 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.958862+0000", 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0091659359999999995 2023-07-29T16:38:52.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959004+0000", 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141092 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:52.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959122+0000", 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118329 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964128+0000", 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050056739999999999 2023-07-29T16:38:53.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965442+0000", 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013143670000000001 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965475+0000", 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2824999999999998e-05 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.965514+0000", 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8933000000000001e-05 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.002 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994724734000002, 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:53.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:53.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:53.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:53.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.013 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994464964999999, 2023-07-29T16:38:53.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:53.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:53.024 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:53.025 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.994394094999997, 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:53.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:53.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:53.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:61411 5.f 5:f97c8622:::benchmark_data_smithi070_97781_object61410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.228848544, 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018542692, 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.034 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 61411 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712459+0000", 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712458+0000", 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712525+0000", 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6715000000000001e-05 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712534+0000", 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2920000000000001e-06 2023-07-29T16:38:53.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712541+0000", 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1029999999999996e-06 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712589+0000", 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8489999999999998e-05 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712724+0000", 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134208 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.712894+0000", 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000170471 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.727900+0000", 2023-07-29T16:38:53.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015006143 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730936+0000", 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0030355849999999999 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.730971+0000", 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5163999999999997e-05 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:38.731001+0000", 2023-07-29T16:38:53.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0267999999999999e-05 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:87822 5.9 5:91e4939f:::benchmark_data_smithi070_97781_object87821:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.044 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:51.275975+0000", 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.665332305, 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019073329999999999, 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.045 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 87822 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.275975+0000", 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.275975+0000", 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.275974+0000", 2023-07-29T16:38:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.276040+0000", 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6247000000000005e-05 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.276048+0000", 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5750000000000003e-06 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.276053+0000", 2023-07-29T16:38:53.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4909999999999996e-06 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.278468+0000", 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024150059999999999 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.278623+0000", 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015457900000000001 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.278754+0000", 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000131261 2023-07-29T16:38:53.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.283172+0000", 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044181869999999996 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.294997+0000", 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011824543999999999 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.295028+0000", 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1306999999999997e-05 2023-07-29T16:38:53.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:51.295048+0000", 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9782000000000001e-05 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.898536742, 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.055 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:38:53.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:38:53.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:38:53.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89440 5.1 5:8899407c:::benchmark_data_smithi070_97781_object89439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.053740+0000", 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.88756690800000004, 2023-07-29T16:38:53.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020652958999999999, 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89440 2023-07-29T16:38:53.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053740+0000", 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053740+0000", 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053739+0000", 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053816+0000", 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6363000000000001e-05 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053828+0000", 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1861999999999999e-05 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053836+0000", 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6989999999999992e-06 2023-07-29T16:38:53.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053874+0000", 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7848000000000001e-05 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.053976+0000", 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010149699999999999 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.054058+0000", 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2211000000000003e-05 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.056520+0000", 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024617279999999998 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074338+0000", 2023-07-29T16:38:53.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.017818575 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074370+0000", 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1986000000000002e-05 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074393+0000", 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2977e-05 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.86638936899999996, 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:53.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:38:53.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:38:53.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:38:53.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89471 5.1 5:8d62ca83:::benchmark_data_smithi070_97781_object89470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.094448+0000", 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.84685957499999998, 2023-07-29T16:38:53.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.022008990999999999, 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89471 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094448+0000", 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094448+0000", 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094446+0000", 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094471+0000", 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4525999999999999e-05 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094483+0000", 2023-07-29T16:38:53.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2573e-05 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094489+0000", 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9050000000000002e-06 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094536+0000", 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7163999999999998e-05 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094673+0000", 2023-07-29T16:38:53.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000136525 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094823+0000", 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014962299999999999 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.101920+0000", 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070978839999999996 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116373+0000", 2023-07-29T16:38:53.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.014452714 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116426+0000", 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2432999999999998e-05 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116457+0000", 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0972000000000001e-05 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.096 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89472 5.1 5:8b25c827:::benchmark_data_smithi070_97781_object89471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.094856+0000", 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.84645124199999999, 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.021708979999999999, 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89472 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094856+0000", 2023-07-29T16:38:53.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094856+0000", 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094855+0000", 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094916+0000", 2023-07-29T16:38:53.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0877e-05 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094923+0000", 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.464e-06 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094930+0000", 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1840000000000004e-06 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096560+0000", 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0016307590000000001 2023-07-29T16:38:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096697+0000", 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000136587 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096857+0000", 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015990000000000001 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.104810+0000", 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079530599999999996 2023-07-29T16:38:53.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116496+0000", 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011686462999999999 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116533+0000", 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7129999999999999e-05 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116565+0000", 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1347999999999999e-05 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89473 5.1 5:82423c33:::benchmark_data_smithi070_97781_object89472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.094943+0000", 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.846364377, 2023-07-29T16:38:53.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.021699261000000001, 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89473 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.108 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094943+0000", 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094943+0000", 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.094942+0000", 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095018+0000", 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6100999999999995e-05 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095030+0000", 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1731e-05 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095036+0000", 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6720000000000001e-06 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.098174+0000", 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031385139999999998 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.098315+0000", 2023-07-29T16:38:53.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014105699999999999 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.098467+0000", 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015180700000000001 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.105060+0000", 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0065925740000000004 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116593+0000", 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011533471999999999 2023-07-29T16:38:53.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116619+0000", 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5964000000000001e-05 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116642+0000", 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.296e-05 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.117 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89482 5.7 5:eecea738:::benchmark_data_smithi070_97781_object89481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.095860+0000", 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.84544747200000003, 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020572420000000001, 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89482 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095860+0000", 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095860+0000", 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095859+0000", 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095917+0000", 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8579000000000003e-05 2023-07-29T16:38:53.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095925+0000", 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3119999999999996e-06 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095929+0000", 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1389999999999997e-06 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.095954+0000", 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4859e-05 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096036+0000", 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1738999999999998e-05 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096165+0000", 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012995199999999999 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.104858+0000", 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0086920680000000007 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116336+0000", 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011478347 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116382+0000", 2023-07-29T16:38:53.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6082999999999999e-05 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116432+0000", 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0056000000000003e-05 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89484 5.7 5:e4065756:::benchmark_data_smithi070_97781_object89483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.096041+0000", 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.84526599800000002, 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.020979477999999999, 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89484 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096041+0000", 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096041+0000", 2023-07-29T16:38:53.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096040+0000", 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096153+0000", 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011281 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096162+0000", 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3279999999999995e-06 2023-07-29T16:38:53.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.096171+0000", 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1219999999999995e-06 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.097606+0000", 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014351539999999999 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.097685+0000", 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8967000000000005e-05 2023-07-29T16:38:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.097766+0000", 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1317999999999996e-05 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.104863+0000", 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070970410000000001 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116934+0000", 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012070745000000001 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.116982+0000", 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8338999999999999e-05 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.117021+0000", 2023-07-29T16:38:53.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8444e-05 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.138 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.74408723799999998, 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.139 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:38:53.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:38:53.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:90209 5.f 5:f4e4b6a5:::benchmark_data_smithi070_97781_object90208:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.553923+0000", 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.38738455599999999, 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.018444437000000001, 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:53.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 90209 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:53.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553923+0000", 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553923+0000", 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.553922+0000", 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554005+0000", 2023-07-29T16:38:53.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3372000000000001e-05 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554013+0000", 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7849999999999992e-06 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554019+0000", 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0700000000000003e-06 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554053+0000", 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3383000000000002e-05 2023-07-29T16:38:53.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554125+0000", 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2143000000000004e-05 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:53.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.554207+0000", 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2090999999999997e-05 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.556547+0000", 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023397650000000002 2023-07-29T16:38:53.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572263+0000", 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.015716434000000001 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:53.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572326+0000", 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2901e-05 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.572367+0000", 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1131000000000003e-05 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.159 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.159 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:53.159 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:53.159 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:53.160 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 37 16 90223 90207 152.364 47.875 0.00307605 0.0064695 2023-07-29T16:38:53.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:53.161 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:53.158+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:53.261 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.259+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:53.293 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90215 5.4 5:2d6c4320:::benchmark_data_smithi070_97781_object90214:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.557036+0000", 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.734279181, 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73430602700000003, 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90215 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557036+0000", 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557036+0000", 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557036+0000", 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557099+0000", 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3319999999999997e-05 2023-07-29T16:38:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557107+0000", 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6350000000000006e-06 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557111+0000", 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6630000000000001e-06 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557147+0000", 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5262000000000002e-05 2023-07-29T16:38:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557233+0000", 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6638999999999995e-05 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.557314+0000", 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1217000000000005e-05 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561589+0000", 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042749600000000004 2023-07-29T16:38:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.569981+0000", 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083920360000000003 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.569992+0000", 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0166000000000001e-05 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90217 5.b 5:d158b5d8:::benchmark_data_smithi070_97781_object90216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.561053+0000", 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.73026208599999998, 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73034639700000004, 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90217 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561053+0000", 2023-07-29T16:38:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561053+0000", 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561052+0000", 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561077+0000", 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5262999999999999e-05 2023-07-29T16:38:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561090+0000", 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2308e-05 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561097+0000", 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0879999999999997e-06 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561136+0000", 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9619000000000001e-05 2023-07-29T16:38:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561233+0000", 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6828000000000002e-05 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.561330+0000", 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6558000000000006e-05 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.568756+0000", 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074265720000000002 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.568766+0000", 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4560000000000006e-06 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90220 5.0 5.92f9610 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.573052+0000", 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.71826290599999998, 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71839204800000001, 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90220 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573052+0000", 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573052+0000", 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573050+0000", 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573103+0000", 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2546000000000001e-05 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573135+0000", 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2286000000000002e-05 2023-07-29T16:38:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573152+0000", 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7557000000000001e-05 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573252+0000", 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9754999999999996e-05 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.573270+0000", 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7427000000000001e-05 2023-07-29T16:38:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90223 5.b 5.36e097db (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.578851+0000", 2023-07-29T16:38:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.71246417200000001, 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71262818100000003, 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90223 2023-07-29T16:38:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578851+0000", 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578851+0000", 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578850+0000", 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578881+0000", 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0889000000000002e-05 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578893+0000", 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2098e-05 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578899+0000", 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9440000000000002e-06 2023-07-29T16:38:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578965+0000", 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5720000000000001e-05 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.578970+0000", 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90206 5.8 5:13811784:::benchmark_data_smithi070_97781_object90205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.553186+0000", 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.73812927299999997, 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.738331077, 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90206 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553186+0000", 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553186+0000", 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553186+0000", 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553225+0000", 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9271999999999999e-05 2023-07-29T16:38:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553230+0000", 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2599999999999996e-06 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553235+0000", 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0180000000000001e-06 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553273+0000", 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7926999999999998e-05 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553389+0000", 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011626200000000001 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.553539+0000", 2023-07-29T16:38:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149882 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.555889+0000", 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023495090000000001 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.569852+0000", 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013963570999999999 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.569862+0000", 2023-07-29T16:38:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5959999999999993e-06 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:90211 5.b 5:de4d5288:::benchmark_data_smithi070_97781_object90210:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.556051+0000", 2023-07-29T16:38:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.73526443900000005, 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73551562100000001, 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "delayed", 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 90211 2023-07-29T16:38:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556051+0000", 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556051+0000", 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556050+0000", 2023-07-29T16:38:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556096+0000", 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6569000000000001e-05 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556109+0000", 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2649999999999999e-05 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556117+0000", 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5689999999999999e-06 2023-07-29T16:38:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556155+0000", 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7963999999999998e-05 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556250+0000", 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5544000000000005e-05 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.556344+0000", 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3444999999999997e-05 2023-07-29T16:38:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.558253+0000", 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019097809999999999 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.568617+0000", 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010363265 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.568631+0000", 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4769e-05 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 6 2023-07-29T16:38:53.347 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:53.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:53.362 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.360+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.434 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:53.454 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:53.455 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:38:53.457 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:38:53.457 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:38:53.463 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:53.461+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:53.475 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:53.475 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:53.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:53.565 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.561+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.567 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:38:53.665 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.662+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.684 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:53.685 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:53.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:53.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-29T16:38:53.769 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.766+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.866 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.864+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:53.883 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:53.883 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:53.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:53.979 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:53.977+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.069 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.066+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 38 16 91362 91346 150.228 71.1875 0.0064431 0.00665366 2023-07-29T16:38:54.112 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:54.113 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:54.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:54.168 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:54.166+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:54.268 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.266+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.341 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:54.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:54.396 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.394+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.470 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:54.468+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:54.523 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:54.523 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:54.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:54.580 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:54.578+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:54.672 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:54.670+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:54.756 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:54.757 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:54.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:54.774 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.771+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.875 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.872+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.976 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:54.973+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:54.984 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:54.985 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:54.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:55.077 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.075+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 39 16 93623 93607 149.999 141.312 0.00303261 0.00666432 2023-07-29T16:38:55.178 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.176+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.184 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:55.184 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:55.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:55.279 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.277+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.337 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:55.337 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:55.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:55.380 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.378+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:55.480 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.479+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.535 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:55.535 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:55.550 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:55.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:38:55.581 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:55.578+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:55.613 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:55.634 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:55.635 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:55.635 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:38:55.637 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:38:55.638 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:38:55.682 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.680+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:55.733 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:55.733 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:55.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:94944 5.d e42/19)", 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.729450+0000", 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0010014819999999999, 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010159839999999999, 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729450+0000", 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729450+0000", 2023-07-29T16:38:55.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729450+0000", 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729453+0000", 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729460+0000", 2023-07-29T16:38:55.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1460000000000001e-06 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729464+0000", 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7570000000000004e-06 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94963 5.0 5.eec2b090 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.729432+0000", 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0010195320000000001, 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001066635, 2023-07-29T16:38:55.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94963 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729432+0000", 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729432+0000", 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729432+0000", 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729506+0000", 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4152000000000004e-05 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729512+0000", 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8220000000000003e-06 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729516+0000", 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3470000000000001e-06 2023-07-29T16:38:55.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94964 5.0 5.ac839ba0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.729524+0000", 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00092832799999999997, 2023-07-29T16:38:55.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010080359999999999, 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94964 2023-07-29T16:38:55.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729524+0000", 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729524+0000", 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729523+0000", 2023-07-29T16:38:55.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729552+0000", 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8711e-05 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729556+0000", 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5070000000000002e-06 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729561+0000", 2023-07-29T16:38:55.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.216e-06 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4749.0:94959 5.d e42/19)", 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.729713+0000", 2023-07-29T16:38:55.751 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00073872900000000003, 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000847848, 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729713+0000", 2023-07-29T16:38:55.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729713+0000", 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729713+0000", 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729717+0000", 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0149999999999997e-06 2023-07-29T16:38:55.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729723+0000", 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729727+0000", 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.756 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94944 5.d 5:bbe2f566:::benchmark_data_smithi070_97781_object94943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.722338+0000", 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0081138779999999997, 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082545899999999992, 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.757 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94944 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722338+0000", 2023-07-29T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722338+0000", 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722337+0000", 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722397+0000", 2023-07-29T16:38:55.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9630999999999999e-05 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722410+0000", 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3002e-05 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.722418+0000", 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8439999999999998e-06 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.723106+0000", 2023-07-29T16:38:55.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00068835800000000003 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.723267+0000", 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016145499999999999 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.723458+0000", 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019091099999999999 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.725930+0000", 2023-07-29T16:38:55.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024719870000000001 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94948 5.0 5:01bfd992:::benchmark_data_smithi070_97781_object94947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726034+0000", 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0044183110000000003, 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004611258, 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94948 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726034+0000", 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726034+0000", 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726033+0000", 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726137+0000", 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010442000000000001 2023-07-29T16:38:55.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726147+0000", 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.516e-06 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726152+0000", 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4689999999999996e-06 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726191+0000", 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8476000000000002e-05 2023-07-29T16:38:55.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726324+0000", 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133483 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94950 5.4 5:2906e1ba:::benchmark_data_smithi070_97781_object94949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726161+0000", 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0042910099999999996, 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045225389999999999, 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94950 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726161+0000", 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726161+0000", 2023-07-29T16:38:55.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726161+0000", 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726205+0000", 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4098999999999999e-05 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726210+0000", 2023-07-29T16:38:55.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0649999999999998e-06 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726214+0000", 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1799999999999998e-06 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726245+0000", 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1004000000000003e-05 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726330+0000", 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499000000000003e-05 2023-07-29T16:38:55.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94952 5.a 5:5533a070:::benchmark_data_smithi070_97781_object94951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726289+0000", 2023-07-29T16:38:55.780 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041629859999999996, 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044324439999999998, 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94952 2023-07-29T16:38:55.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726289+0000", 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726289+0000", 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726288+0000", 2023-07-29T16:38:55.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726424+0000", 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013532 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726435+0000", 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1737e-05 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726444+0000", 2023-07-29T16:38:55.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3979999999999999e-06 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726484+0000", 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726588+0000", 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104662 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94954 5.a 5:532f717c:::benchmark_data_smithi070_97781_object94953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726459+0000", 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039932750000000001, 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043024320000000001, 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94954 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726459+0000", 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726459+0000", 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726458+0000", 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726494+0000", 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5806999999999998e-05 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726502+0000", 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5420000000000005e-06 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726508+0000", 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3260000000000001e-06 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729365+0000", 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028560650000000001 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729549+0000", 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018435200000000001 2023-07-29T16:38:55.794 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94955 5.8 5:177c22ea:::benchmark_data_smithi070_97781_object94954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726515+0000", 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039366139999999997, 2023-07-29T16:38:55.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042833890000000003, 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94955 2023-07-29T16:38:55.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726515+0000", 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726515+0000", 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726515+0000", 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726556+0000", 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0933999999999998e-05 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726564+0000", 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726570+0000", 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3960000000000003e-06 2023-07-29T16:38:55.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726612+0000", 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2079000000000001e-05 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726723+0000", 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011069300000000001 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94956 5.0 5:080ec436:::benchmark_data_smithi070_97781_object94955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.802 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726580+0000", 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0038717449999999998, 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042574190000000001, 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94956 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726580+0000", 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726580+0000", 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726580+0000", 2023-07-29T16:38:55.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726614+0000", 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425000000000003e-05 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726623+0000", 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1730000000000001e-06 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726629+0000", 2023-07-29T16:38:55.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6370000000000004e-06 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729198+0000", 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025691799999999999 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729353+0000", 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015545700000000001 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94959 5.d 5:b8bc7148:::benchmark_data_smithi070_97781_object94958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726754+0000", 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0036982439999999998, 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041220880000000003, 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:55.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94959 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726754+0000", 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726754+0000", 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726753+0000", 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726829+0000", 2023-07-29T16:38:55.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5784999999999994e-05 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726838+0000", 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6069999999999997e-06 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726846+0000", 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4100000000000002e-06 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726943+0000", 2023-07-29T16:38:55.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7541999999999995e-05 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727091+0000", 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014760199999999999 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727260+0000", 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016875599999999999 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94960 5.4 5:257fed98:::benchmark_data_smithi070_97781_object94959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.726859+0000", 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.003592717, 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040576120000000004, 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94960 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726859+0000", 2023-07-29T16:38:55.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726859+0000", 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726859+0000", 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726890+0000", 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1093999999999997e-05 2023-07-29T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726898+0000", 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5979999999999997e-06 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.726905+0000", 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.489e-06 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729325+0000", 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024203829999999999 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.729458+0000", 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132547 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:94958 5.f e42/19 5:f3ab8216:::benchmark_data_smithi070_97781_object94957:head v 42'5870, mlcod=42'5868)", 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.727127+0000", 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.003324811, 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038257780000000002, 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.825 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727127+0000", 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727127+0000", 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727126+0000", 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727195+0000", 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8225999999999994e-05 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727204+0000", 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2839999999999995e-06 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727210+0000", 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5590000000000002e-06 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727251+0000", 2023-07-29T16:38:55.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0046999999999998e-05 2023-07-29T16:38:55.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.727269+0000", 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8309999999999999e-05 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:94961 5.b 5:db47185d:::benchmark_data_smithi070_97781_object94960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:55.728084+0000", 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0023679299999999999, 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029033869999999999, 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:55.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 94961 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:55.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728084+0000", 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728084+0000", 2023-07-29T16:38:55.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728083+0000", 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728168+0000", 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4804999999999999e-05 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728178+0000", 2023-07-29T16:38:55.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7140000000000005e-06 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728185+0000", 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5460000000000003e-06 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728230+0000", 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5012000000000002e-05 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:55.728309+0000", 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.928e-05 2023-07-29T16:38:55.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 15 2023-07-29T16:38:55.839 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:55.840 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:55.838+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:55.841 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:55.941 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:55.940+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:56.043 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:56.041+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:56.058 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:56.059 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:38:56.059 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:38:56.059 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:38:56.059 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:56.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:56.077 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:2023-07-29T16:38:56.076503+0000 min lat: 0.00112574 max lat: 1.03406 avg lat: 0.00667793 2023-07-29T16:38:56.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-07-29T16:38:56.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 40 16 95824 95808 149.687 137.562 0.00615184 0.00667793 2023-07-29T16:38:56.144 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:56.141+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:56.245 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:56.242+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:56.289 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:56.289 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.337370434, 2023-07-29T16:38:56.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019679057, 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947311+0000", 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947294+0000", 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999838 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947322+0000", 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7406000000000002e-05 2023-07-29T16:38:56.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947336+0000", 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4464000000000001e-05 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947349+0000", 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3183000000000001e-05 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948420+0000", 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001070234 2023-07-29T16:38:56.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948426+0000", 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2949999999999999e-06 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960831+0000", 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012405467 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.960930+0000", 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8258999999999996e-05 2023-07-29T16:38:56.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961020+0000", 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0577999999999999e-05 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962561+0000", 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00154061 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966890+0000", 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043294429999999997 2023-07-29T16:38:56.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966952+0000", 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1987000000000001e-05 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.966990+0000", 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271999999999998e-05 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.337069448999998, 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019464111999999999, 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947612+0000", 2023-07-29T16:38:56.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947611+0000", 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947618+0000", 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9650000000000002e-06 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947628+0000", 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0740000000000001e-05 2023-07-29T16:38:56.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.947637+0000", 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9050000000000003e-06 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948491+0000", 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085369500000000002 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.948497+0000", 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4979999999999997e-06 2023-07-29T16:38:56.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961294+0000", 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012797693000000001 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961576+0000", 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028189099999999999 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.961718+0000", 2023-07-29T16:38:56.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014146699999999999 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.962971+0000", 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012539129999999999 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967030+0000", 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040582539999999999 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967056+0000", 2023-07-29T16:38:56.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6571e-05 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:37:53.967076+0000", 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.933e-05 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:79750 5.d 5:be8bb69d:::benchmark_data_smithi070_97781_object79749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8531263379999992, 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019645072, 2023-07-29T16:38:56.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 79750 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431555+0000", 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431554+0000", 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431671+0000", 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117586 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431681+0000", 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2229999999999996e-06 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.431686+0000", 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:38:56.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436387+0000", 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047008199999999997 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436494+0000", 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106919 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.436595+0000", 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100898 2023-07-29T16:38:56.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.437788+0000", 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001193403 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451136+0000", 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013347835000000001 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451171+0000", 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5074999999999999e-05 2023-07-29T16:38:56.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:47.451200+0000", 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8413000000000001e-05 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2342205179999999, 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:38:56.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.334 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2341366880000004, 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:38:56.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:38:56.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2315937229999996, 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:38:56.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:38:56.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:38:56.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:38:56.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2168336770000003, 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:56.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:38:56.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:38:56.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:38:56.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:38:56.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.366 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89451 5.4 5:2720ee21:::benchmark_data_smithi070_97781_object89450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2098498620000004, 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020199971000000001, 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89451 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074831+0000", 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074830+0000", 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074904+0000", 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3059999999999995e-05 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074913+0000", 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3190000000000001e-06 2023-07-29T16:38:56.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074925+0000", 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2051e-05 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074962+0000", 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7358999999999999e-05 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.075082+0000", 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011948899999999999 2023-07-29T16:38:56.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.075222+0000", 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000140221 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.077871+0000", 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026492849999999999 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.094939+0000", 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017068175000000001 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.094991+0000", 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1362000000000001e-05 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095031+0000", 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0296999999999997e-05 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.377 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89476 5.0 5:0ddffb84:::benchmark_data_smithi070_97781_object89475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1895311550000001, 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021368195, 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89476 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:56.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095149+0000", 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095356+0000", 2023-07-29T16:38:56.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206844 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095362+0000", 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6110000000000001e-06 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095366+0000", 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3100000000000002e-06 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:38:56.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3018999999999997e-05 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095493+0000", 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3429000000000003e-05 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095624+0000", 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013110800000000001 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.100791+0000", 2023-07-29T16:38:56.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051678169999999999 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116459+0000", 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015667793999999999 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116495+0000", 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5410000000000001e-05 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116518+0000", 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3339000000000001e-05 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.388 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1893076310000001, 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:56.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:38:56.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:38:56.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:38:56.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:38:56.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.399 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1891478270000002, 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:38:56.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:38:56.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:38:56.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:38:56.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:38:56.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:38:56.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:38:56.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:38:56.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1850206749999996, 2023-07-29T16:38:56.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:38:56.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:38:56.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.17937387, 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:38:56.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:38:56.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89534 5.0 5:0ce20406:::benchmark_data_smithi070_97781_object89533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1450493049999997, 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020677213999999999, 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89534 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139631+0000", 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139730+0000", 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9395000000000006e-05 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139743+0000", 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2388999999999999e-05 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139751+0000", 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1899999999999995e-06 2023-07-29T16:38:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143810+0000", 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040596460000000001 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143920+0000", 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109638 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.144004+0000", 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4307000000000004e-05 2023-07-29T16:38:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.148076+0000", 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004071206 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160259+0000", 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012183131 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160287+0000", 2023-07-29T16:38:56.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8450999999999999e-05 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160309+0000", 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1716e-05 2023-07-29T16:38:56.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1343845769999996, 2023-07-29T16:38:56.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:38:56.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:38:56.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.455 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:38:56.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0773016699999998, 2023-07-29T16:38:56.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.456 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:56.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:38:56.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:38:56.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0772275870000003, 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:38:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:38:56.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:38:56.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:38:56.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0770291719999996, 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:38:56.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:38:56.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:38:56.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:38:56.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:38:56.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0766478529999999, 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:38:56.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:38:56.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:38:56.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:38:56.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:56.498 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0752547300000002, 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:56.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:38:56.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:38:56.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:38:56.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:38:56.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:56.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:56.509 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:56.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:56.511 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:56.508+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:38:56.611 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:56.609+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:56.691 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:56.691 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:56.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.691 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97130 5.3 5:cf114c8f:::benchmark_data_smithi070_97781_object97129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.691 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.681470+0000", 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0069583220000000003, 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0069865980000000001, 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.693 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97130 2023-07-29T16:38:56.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.693 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681470+0000", 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681470+0000", 2023-07-29T16:38:56.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681469+0000", 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681532+0000", 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3219000000000006e-05 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681545+0000", 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2564e-05 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681554+0000", 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0620000000000007e-06 2023-07-29T16:38:56.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681595+0000", 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1047999999999997e-05 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.681724+0000", 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012876599999999999 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.699 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97134 5.2 5:4202279d:::benchmark_data_smithi070_97781_object97133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.683230+0000", 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0051985269999999997, 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053013469999999997, 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97134 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683230+0000", 2023-07-29T16:38:56.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683230+0000", 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683229+0000", 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683332+0000", 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010282599999999999 2023-07-29T16:38:56.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683342+0000", 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.859e-06 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683347+0000", 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5620000000000003e-06 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683377+0000", 2023-07-29T16:38:56.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0015999999999999e-05 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.683462+0000", 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4987999999999993e-05 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.706 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:97133 5.d e43/19 5:b9d10181:::benchmark_data_smithi070_97781_object97132:head v 43'6101, mlcod=43'6098)", 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.684979+0000", 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0034489799999999999, 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0036156500000000002, 2023-07-29T16:38:56.707 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.684979+0000", 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.684979+0000", 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.684979+0000", 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.685026+0000", 2023-07-29T16:38:56.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7509000000000002e-05 2023-07-29T16:38:56.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.685035+0000", 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4910000000000005e-06 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.685039+0000", 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7489999999999998e-06 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.685072+0000", 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2954999999999999e-05 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.685086+0000", 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3619e-05 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97136 5.7 5:e32c0ccb:::benchmark_data_smithi070_97781_object97135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.686357+0000", 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0020708990000000002, 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023060110000000002, 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97136 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686357+0000", 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686357+0000", 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686357+0000", 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686413+0000", 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6005000000000003e-05 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686422+0000", 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8130000000000007e-06 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686428+0000", 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1590000000000001e-06 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686460+0000", 2023-07-29T16:38:56.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2011000000000002e-05 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.686542+0000", 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2144000000000005e-05 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.721 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97138 5.5 5:a1988e7a:::benchmark_data_smithi070_97781_object97137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.687767+0000", 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00066132300000000001, 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096377699999999997, 2023-07-29T16:38:56.722 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97138 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.723 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687767+0000", 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687767+0000", 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687766+0000", 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687813+0000", 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6173e-05 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687820+0000", 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2760000000000003e-06 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687824+0000", 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1320000000000004e-06 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687866+0000", 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2095999999999998e-05 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687992+0000", 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012551700000000001 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97139 5.c 5:38222563:::benchmark_data_smithi070_97781_object97138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.687830+0000", 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00059815300000000003, 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096529999999999999, 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97139 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687830+0000", 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687830+0000", 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687830+0000", 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687868+0000", 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7777000000000001e-05 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687872+0000", 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6349999999999997e-06 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687875+0000", 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1039999999999998e-06 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687917+0000", 2023-07-29T16:38:56.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1733999999999997e-05 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.688028+0000", 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111283 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.736 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97140 5.3 5:cc73bc51:::benchmark_data_smithi070_97781_object97139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.687885+0000", 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00054374499999999999, 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00097549300000000002, 2023-07-29T16:38:56.737 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97140 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687885+0000", 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687885+0000", 2023-07-29T16:38:56.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687884+0000", 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687930+0000", 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.587e-05 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687943+0000", 2023-07-29T16:38:56.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2785e-05 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687949+0000", 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.687986+0000", 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6905e-05 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.688070+0000", 2023-07-29T16:38:56.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3530999999999997e-05 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:97122 5.9 5:9306ce26:::benchmark_data_smithi070_97781_object97121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.678481+0000", 2023-07-29T16:38:56.744 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0099469339999999993, 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010446525, 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:56.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 97122 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678481+0000", 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678481+0000", 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678481+0000", 2023-07-29T16:38:56.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678511+0000", 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0012e-05 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678518+0000", 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5360000000000004e-06 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678524+0000", 2023-07-29T16:38:56.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9340000000000003e-06 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678558+0000", 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3813000000000003e-05 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678660+0000", 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010196099999999999 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.678787+0000", 2023-07-29T16:38:56.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012745599999999999 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.682757+0000", 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039699380000000001 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.753 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:56.753 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:38:56.753 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 8 2023-07-29T16:38:56.753 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:56.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:56.755 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:56.752+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:56.856 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:56.853+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:56.893 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:38:56.957 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:56.954+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:56.979 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:56.979 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:38:56.979 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:38:56.979 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:38:56.980 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:56.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:57.006 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-07-29T16:38:57.057 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:57.055+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:57.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 41 16 98100 98084 149.506 142.25 0.00535266 0.00668615 2023-07-29T16:38:57.107 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-07-29T16:38:57.158 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:57.156+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:57.213 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:38:57.213 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:38:57.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:38:57.214 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:38:57.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.214 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 74.687869241000001, 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:38:57.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:38:57.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:38:57.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:38:57.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:38:57.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 63.262774641999997, 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:38:57.228 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:38:57.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:38:57.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:38:57.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:38:57.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.240 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 63.262514873000001, 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:57.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:38:57.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:38:57.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:38:57.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 63.262444002999999, 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:57.253 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:38:57.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:38:57.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:38:57.261 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:57.262 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.1665866500000002, 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:57.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:38:57.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:38:57.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:38:57.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:38:57.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:38:57.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:38:57.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:38:57.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:38:57.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:38:57.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:38:57.276 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.276 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.276 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.1344392770000002, 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.277 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:38:57.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:38:57.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:38:57.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:38:57.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:38:57.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:38:57.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:57.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:38:57.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.290 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0121371459999997, 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.291 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:38:57.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:38:57.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:38:57.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:38:57.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:38:57.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:38:57.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:38:57.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:38:57.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:38:57.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:38:57.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:38:57.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:38:57.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:38:57.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:38:57.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:38:57.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:38:57.306 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.306 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.306 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.307 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.307 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:38:57.308 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79466527200000003, 2023-07-29T16:38:57.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:38:57.308 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.309 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.309 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.310 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:38:57.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.310 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:38:57.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:38:57.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:38:57.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:38:57.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:38:57.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:38:57.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:38:57.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:38:57.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:38:57.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:38:57.323 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.323 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.323 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.324 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.325 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:38:57.325 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79214485999999995, 2023-07-29T16:38:57.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:38:57.326 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.326 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.326 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.326 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.327 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:38:57.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.328 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:38:57.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:38:57.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:38:57.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:38:57.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:38:57.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:38:57.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.338 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79202311400000003, 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.339 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:38:57.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.340 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:38:57.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:38:57.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:38:57.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:38:57.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:38:57.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:38:57.349 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79178114899999996, 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.350 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:38:57.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:38:57.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:38:57.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:38:57.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:38:57.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:38:57.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:38:57.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:38:57.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:38:57.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:38:57.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79163089499999995, 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:38:57.364 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:38:57.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:38:57.373 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79155249900000002, 2023-07-29T16:38:57.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:38:57.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.376 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:38:57.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:38:57.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:38:57.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.791508023, 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.385 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:38:57.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:38:57.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79106288899999999, 2023-07-29T16:38:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:38:57.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:38:57.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:38:57.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:38:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.405 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:38:57.406 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.79097674100000004, 2023-07-29T16:38:57.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:38:57.406 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.406 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.406 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:38:57.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:38:57.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:38:57.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.78997659799999997, 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.416 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.417 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:38:57.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:38:57.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:38:57.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.425 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.78964278499999996, 2023-07-29T16:38:57.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:38:57.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:38:57.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:38:57.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:38:57.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:38:57.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:38:57.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:38:57.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.436 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.78493225099999997, 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:38:57.437 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:38:57.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:38:57.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:38:57.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:38:57.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:38:57.445 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.78462098999999996, 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.446 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:38:57.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:38:57.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:38:57.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:38:57.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:38:57.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:38:57.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:38:57.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:38:57.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:38:57.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:38:57.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:38:57.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:38:57.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:38:57.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:38:57.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:38:57.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:38:57.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:38:57.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:38:57.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:38:57.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:38:57.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:38:57.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:38:57.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:38:57.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:38:57.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:38:57.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:38:57.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:38:57.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:38:57.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:38:57.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:38:57.463 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:38:57.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:57.466 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:57.463+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:57.565 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:57.564+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:57.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:38:57.643 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99491 5.b 5:dde6fcbf:::benchmark_data_smithi070_97781_object99490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.634680+0000", 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0064991220000000004, 2023-07-29T16:38:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065283049999999999, 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99491 2023-07-29T16:38:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634680+0000", 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634680+0000", 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634679+0000", 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634736+0000", 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7068999999999999e-05 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634757+0000", 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1463000000000001e-05 2023-07-29T16:38:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634785+0000", 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7990000000000001e-05 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634828+0000", 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2110000000000002e-05 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634905+0000", 2023-07-29T16:38:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7019000000000002e-05 2023-07-29T16:38:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99493 5.b 5:d4aa0611:::benchmark_data_smithi070_97781_object99492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.634807+0000", 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.006372473, 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064910699999999998, 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99493 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634807+0000", 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634807+0000", 2023-07-29T16:38:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634806+0000", 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634837+0000", 2023-07-29T16:38:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0744999999999998e-05 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634846+0000", 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1509999999999993e-06 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.634853+0000", 2023-07-29T16:38:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1600000000000001e-06 2023-07-29T16:38:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636724+0000", 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018707070000000001 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636909+0000", 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018533499999999999 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99496 5.0 5:05c2da1f:::benchmark_data_smithi070_97781_object99495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.635867+0000", 2023-07-29T16:38:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0053119669999999999, 2023-07-29T16:38:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054991750000000002, 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99496 2023-07-29T16:38:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635867+0000", 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635867+0000", 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635866+0000", 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635921+0000", 2023-07-29T16:38:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5077999999999997e-05 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635943+0000", 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1639999999999999e-05 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635960+0000", 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7538999999999999e-05 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636001+0000", 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0571999999999997e-05 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636127+0000", 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012612300000000001 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99498 5.8 5:1afa5be6:::benchmark_data_smithi070_97781_object99497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.635972+0000", 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0052069259999999997, 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054598169999999996, 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99498 2023-07-29T16:38:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635972+0000", 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635972+0000", 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.635972+0000", 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636047+0000", 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999995e-05 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636060+0000", 2023-07-29T16:38:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3389e-05 2023-07-29T16:38:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636068+0000", 2023-07-29T16:38:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6389999999999992e-06 2023-07-29T16:38:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636092+0000", 2023-07-29T16:38:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4644e-05 2023-07-29T16:38:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636177+0000", 2023-07-29T16:38:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5030000000000004e-05 2023-07-29T16:38:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99503 5.e 5:72e6147c:::benchmark_data_smithi070_97781_object99502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.636725+0000", 2023-07-29T16:38:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004453968, 2023-07-29T16:38:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047730369999999999, 2023-07-29T16:38:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99503 2023-07-29T16:38:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636725+0000", 2023-07-29T16:38:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636725+0000", 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636724+0000", 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636780+0000", 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6011000000000003e-05 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636790+0000", 2023-07-29T16:38:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0044000000000001e-05 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636798+0000", 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.644e-06 2023-07-29T16:38:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636848+0000", 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0152999999999999e-05 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.636968+0000", 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012019 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99504 5.8 5:1d5b098b:::benchmark_data_smithi070_97781_object99503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.639266+0000", 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0019128439999999999, 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002296803, 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99504 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639266+0000", 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639266+0000", 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639265+0000", 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639294+0000", 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8436999999999999e-05 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639306+0000", 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1987000000000001e-05 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639312+0000", 2023-07-29T16:38:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6150000000000002e-06 2023-07-29T16:38:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639338+0000", 2023-07-29T16:38:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5590000000000001e-05 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639438+0000", 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010002500000000001 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99505 5.b 5:dd412850:::benchmark_data_smithi070_97781_object99504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.639379+0000", 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001800177, 2023-07-29T16:38:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022564640000000001, 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99505 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639379+0000", 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639379+0000", 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639378+0000", 2023-07-29T16:38:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639433+0000", 2023-07-29T16:38:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4623000000000002e-05 2023-07-29T16:38:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639438+0000", 2023-07-29T16:38:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4280000000000004e-06 2023-07-29T16:38:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639442+0000", 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.715e-06 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639806+0000", 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036350999999999999 2023-07-29T16:38:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.639919+0000", 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011311000000000001 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99506 5.d 5:b2091fd5:::benchmark_data_smithi070_97781_object99505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.640390+0000", 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00078898399999999995, 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013125680000000001, 2023-07-29T16:38:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99506 2023-07-29T16:38:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640390+0000", 2023-07-29T16:38:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640390+0000", 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640389+0000", 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640443+0000", 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4086999999999999e-05 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640455+0000", 2023-07-29T16:38:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1933000000000001e-05 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640464+0000", 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8370000000000003e-06 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640514+0000", 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9521999999999998e-05 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640653+0000", 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139457 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640815+0000", 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161488 2023-07-29T16:38:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99508 5.a 5:5b7b700f:::benchmark_data_smithi070_97781_object99507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:38:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.640752+0000", 2023-07-29T16:38:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00042690399999999998, 2023-07-29T16:38:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010210760000000001, 2023-07-29T16:38:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:38:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:38:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:38:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99508 2023-07-29T16:38:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640752+0000", 2023-07-29T16:38:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640752+0000", 2023-07-29T16:38:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640751+0000", 2023-07-29T16:38:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640822+0000", 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0655999999999996e-05 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640831+0000", 2023-07-29T16:38:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6100000000000006e-06 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640839+0000", 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9629999999999998e-06 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.640883+0000", 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4178000000000003e-05 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641026+0000", 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014306799999999999 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:99507 5.f e43/19 5:ff784b05:::benchmark_data_smithi070_97781_object99506:head v 43'6133, mlcod=43'6131)", 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.641096+0000", 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.3395999999999999e-05, 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00073894900000000003, 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:38:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641096+0000", 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:38:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641096+0000", 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641095+0000", 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:38:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641164+0000", 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9067999999999997e-05 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641173+0000", 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0629999999999995e-06 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641179+0000", 2023-07-29T16:38:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1059999999999996e-06 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641217+0000", 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7910999999999997e-05 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:38:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.641232+0000", 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5191000000000001e-05 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:38:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:38:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2023-07-29T16:38:57.741 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:38:57.742 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:57.743 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:57.740+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:57.792 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:57.812 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:38:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:38:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:38:57.815 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:38:57.816 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:38:57.842 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:57.840+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:57.914 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:57.915 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:57.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:57.943 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:57.942+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:58.045 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:58.043+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:58.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 42 16 100520 100504 149.547 151.25 0.00390099 0.00668394 2023-07-29T16:38:58.145 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.143+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.154 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:58.155 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:58.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:58.247 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.245+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.348 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.346+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.353 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:58.353 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:58.370 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:58.449 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:58.447+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:58.547 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:58.548 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:58.550 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.548+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:58.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:38:58.651 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.649+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.754 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:58.750+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:58.777 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:58.777 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:58.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:38:58.852 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.850+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.954 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:58.951+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:58.969 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:58.969 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:58.984 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:38:59.054 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.052+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 43 16 102828 102812 149.424 144.25 0.00717055 0.00668995 2023-07-29T16:38:59.155 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.154+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:59.195 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:59.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:38:59.256 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:59.254+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:59.357 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.355+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.376 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:59.376 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:59.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:38:59.458 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:59.456+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:59.559 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.557+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.569 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:59.569 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:59.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2023-07-29T16:38:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:38:59.584 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:38:59.669 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.667+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.760 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.759+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.802 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:38:59.802 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:38:59.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:38:59.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:38:59.861 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:38:59.860+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:38:59.962 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:38:59.961+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:38:59.968 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:38:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:38:59.990 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:38:59.990 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:38:59.991 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:38:59.993 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:38:59.993 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:00.043 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:00.043 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 77.516321614999995, 2023-07-29T16:39:00.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:00.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:00.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:00.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:00.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:00.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:00.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 66.091227016000005, 2023-07-29T16:39:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 66.090967246999995, 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 66.090896377000007, 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.9950390240000004, 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.9628916509999996, 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.84058952, 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6231176459999999, 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.139 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:00.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:00.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6205972339999999, 2023-07-29T16:39:00.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:00.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6204754879999999, 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:00.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:00.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:00.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.167 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.620233523, 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:00.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:00.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:00.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6200832690000002, 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:00.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:00.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6200048730000001, 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:00.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:00.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:00.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.195 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6199603969999998, 2023-07-29T16:39:00.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.197 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:00.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:00.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:00.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6195152630000003, 2023-07-29T16:39:00.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.206 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:00.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:00.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:00.214 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.619429115, 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:00.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:00.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:00.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:00.223 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6184289720000002, 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.224 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:00.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:00.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:00.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.232 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6180951590000001, 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:00.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.241 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6133846250000001, 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6130733639999999, 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:00.259 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:00.260 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 44 16 105196 105180 149.391 148 0.00449337 0.0066915 2023-07-29T16:39:00.261 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:00.258+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:00.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:00.361 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:00.359+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:00.434 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106039 5.4 5:2f59847b:::benchmark_data_smithi070_97781_object106038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.420423+0000", 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011707822999999999, 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011730381, 2023-07-29T16:39:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106039 2023-07-29T16:39:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420423+0000", 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420423+0000", 2023-07-29T16:39:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420423+0000", 2023-07-29T16:39:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420459+0000", 2023-07-29T16:39:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532999999999997e-05 2023-07-29T16:39:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420469+0000", 2023-07-29T16:39:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5040000000000008e-06 2023-07-29T16:39:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420476+0000", 2023-07-29T16:39:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.951e-06 2023-07-29T16:39:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.424409+0000", 2023-07-29T16:39:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039332849999999999 2023-07-29T16:39:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.424495+0000", 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6664999999999998e-05 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106043 5.4 5:29fff88a:::benchmark_data_smithi070_97781_object106042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011591974999999999, 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011670183000000001, 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106043 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420564+0000", 2023-07-29T16:39:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5885999999999999e-05 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420573+0000", 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1769999999999998e-06 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420578+0000", 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7919999999999998e-06 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.428893+0000", 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083148809999999997 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429002+0000", 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108243 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106045 5.a 5:541109d9:::benchmark_data_smithi070_97781_object106044:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.420839+0000", 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011291967999999999, 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011413977, 2023-07-29T16:39:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106045 2023-07-29T16:39:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420839+0000", 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420839+0000", 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420838+0000", 2023-07-29T16:39:00.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420910+0000", 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1371999999999994e-05 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420923+0000", 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3349e-05 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420931+0000", 2023-07-29T16:39:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7039999999999994e-06 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422624+0000", 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001693696 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422769+0000", 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014447900000000001 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106047 5.a 5:52ce838f:::benchmark_data_smithi070_97781_object106046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.422878+0000", 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0092531929999999998, 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094181809999999994, 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106047 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422878+0000", 2023-07-29T16:39:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422878+0000", 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422877+0000", 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422930+0000", 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3489999999999998e-05 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422940+0000", 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9629999999999993e-06 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422948+0000", 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.289e-06 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.425090+0000", 2023-07-29T16:39:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021426539999999999 2023-07-29T16:39:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.425207+0000", 2023-07-29T16:39:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011684399999999999 2023-07-29T16:39:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106048 5.a 5:50cb9131:::benchmark_data_smithi070_97781_object106047:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.422958+0000", 2023-07-29T16:39:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0091727430000000006, 2023-07-29T16:39:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093805120000000006, 2023-07-29T16:39:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106048 2023-07-29T16:39:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422958+0000", 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422958+0000", 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422958+0000", 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422991+0000", 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3552e-05 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.422998+0000", 2023-07-29T16:39:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8979999999999999e-06 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.423004+0000", 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5439999999999998e-06 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.428653+0000", 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005649556 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.428748+0000", 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4767999999999998e-05 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106052 5.a 5:56b0815c:::benchmark_data_smithi070_97781_object106051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.427356+0000", 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0047752350000000001, 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050223409999999996, 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106052 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427356+0000", 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427356+0000", 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427355+0000", 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427390+0000", 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4870000000000003e-05 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427401+0000", 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1637999999999999e-05 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.427407+0000", 2023-07-29T16:39:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.93e-06 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.431989+0000", 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045812209999999999 2023-07-29T16:39:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432117+0000", 2023-07-29T16:39:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128038 2023-07-29T16:39:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106054 5.4 5:2e22ad98:::benchmark_data_smithi070_97781_object106053:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.429159+0000", 2023-07-29T16:39:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029721180000000002, 2023-07-29T16:39:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032592739999999999, 2023-07-29T16:39:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106054 2023-07-29T16:39:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429159+0000", 2023-07-29T16:39:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429159+0000", 2023-07-29T16:39:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429158+0000", 2023-07-29T16:39:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429208+0000", 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9592999999999998e-05 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429215+0000", 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7009999999999996e-06 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429221+0000", 2023-07-29T16:39:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.431216+0000", 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001995466 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.431355+0000", 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013882599999999999 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106055 5.d 5:bb5e1a93:::benchmark_data_smithi070_97781_object106054:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.429228+0000", 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029027459999999999, 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032307170000000001, 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106055 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429228+0000", 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429228+0000", 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429228+0000", 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429270+0000", 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1925000000000003e-05 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429277+0000", 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6979999999999998e-06 2023-07-29T16:39:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429281+0000", 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.676e-06 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429332+0000", 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1289000000000003e-05 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429449+0000", 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116959 2023-07-29T16:39:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429581+0000", 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013190899999999999 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106058 5.8 5:173410d2:::benchmark_data_smithi070_97781_object106057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.429288+0000", 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028425170000000001, 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032118030000000001, 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106058 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429288+0000", 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429288+0000", 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429288+0000", 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429338+0000", 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9486e-05 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429343+0000", 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1839999999999998e-06 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429346+0000", 2023-07-29T16:39:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5410000000000001e-06 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429388+0000", 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1564999999999999e-05 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429511+0000", 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122853 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106059 5.8 5:13b0de4f:::benchmark_data_smithi070_97781_object106058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.429359+0000", 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002772058, 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031794530000000001, 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106059 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429359+0000", 2023-07-29T16:39:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429359+0000", 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429358+0000", 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429400+0000", 2023-07-29T16:39:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1919999999999998e-05 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429407+0000", 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0339999999999999e-06 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429413+0000", 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.998e-06 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.431261+0000", 2023-07-29T16:39:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018472110000000001 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.431379+0000", 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011872800000000001 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:106057 5.9 e44/19 5:90f21f4c:::benchmark_data_smithi070_97781_object106056:head v 44'6642, mlcod=44'6640)", 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.429468+0000", 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002663295, 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031071990000000002, 2023-07-29T16:39:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429468+0000", 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429468+0000", 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429467+0000", 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429537+0000", 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0001999999999998e-05 2023-07-29T16:39:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429546+0000", 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2709999999999998e-06 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429552+0000", 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8719999999999999e-06 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429583+0000", 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0368000000000001e-05 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429608+0000", 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5063999999999999e-05 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106061 5.4 5.54f23af4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.432308+0000", 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998231, 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030964000000000002, 2023-07-29T16:39:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106061 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432308+0000", 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432308+0000", 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432307+0000", 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432367+0000", 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432383+0000", 2023-07-29T16:39:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6039e-05 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432390+0000", 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8299999999999998e-06 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106062 5.e 5.e00207e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.432407+0000", 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9997244, 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025106899999999998, 2023-07-29T16:39:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106062 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432407+0000", 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432407+0000", 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432406+0000", 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432434+0000", 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7849000000000001e-05 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432441+0000", 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6660000000000002e-06 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432446+0000", 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7300000000000002e-06 2023-07-29T16:39:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432650+0000", 2023-07-29T16:39:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203246 2023-07-29T16:39:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106063 5.a 5.e518f3ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.432624+0000", 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9995074, 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5395000000000006e-05, 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106063 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432624+0000", 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432624+0000", 2023-07-29T16:39:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432623+0000", 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432650+0000", 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6869999999999999e-05 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432660+0000", 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8579999999999995e-06 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.432666+0000", 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0750000000000003e-06 2023-07-29T16:39:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 14 2023-07-29T16:39:00.553 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:00.554 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:00.553+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:00.555 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:00.655 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:00.653+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:00.756 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:00.754+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:00.760 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:00.761 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:00.774 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:00.857 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:00.856+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:00.958 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:00.956+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:00.993 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9392097849999992, 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9391259549999997, 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9365829899999998, 2023-07-29T16:39:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9218229440000005, 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89476 5.0 5:0ddffb84:::benchmark_data_smithi070_97781_object89475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8945204219999994, 2023-07-29T16:39:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021368195, 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89476 2023-07-29T16:39:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095150+0000", 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095149+0000", 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095356+0000", 2023-07-29T16:39:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206844 2023-07-29T16:39:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095362+0000", 2023-07-29T16:39:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6110000000000001e-06 2023-07-29T16:39:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095366+0000", 2023-07-29T16:39:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3100000000000002e-06 2023-07-29T16:39:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3018999999999997e-05 2023-07-29T16:39:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095493+0000", 2023-07-29T16:39:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3429000000000003e-05 2023-07-29T16:39:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095624+0000", 2023-07-29T16:39:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013110800000000001 2023-07-29T16:39:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.100791+0000", 2023-07-29T16:39:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051678169999999999 2023-07-29T16:39:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116459+0000", 2023-07-29T16:39:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015667793999999999 2023-07-29T16:39:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116495+0000", 2023-07-29T16:39:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5410000000000001e-05 2023-07-29T16:39:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.116518+0000", 2023-07-29T16:39:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3339000000000001e-05 2023-07-29T16:39:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8942968980000003, 2023-07-29T16:39:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8941370939999995, 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8900099420000007, 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8843631369999994, 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89534 5.0 5:0ce20406:::benchmark_data_smithi070_97781_object89533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8500385720000008, 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020677213999999999, 2023-07-29T16:39:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89534 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139632+0000", 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139631+0000", 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139730+0000", 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9395000000000006e-05 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139743+0000", 2023-07-29T16:39:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2388999999999999e-05 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.139751+0000", 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1899999999999995e-06 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143810+0000", 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040596460000000001 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.143920+0000", 2023-07-29T16:39:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109638 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.144004+0000", 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4307000000000004e-05 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.148076+0000", 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004071206 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160259+0000", 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012183131 2023-07-29T16:39:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160287+0000", 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8450999999999999e-05 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.160309+0000", 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1716e-05 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8393738440000007, 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7822909369999991, 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7822168539999996, 2023-07-29T16:39:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7820184389999998, 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7816371199999992, 2023-07-29T16:39:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7802439969999995, 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99338 5.0 5:0ba602d2:::benchmark_data_smithi070_97781_object99337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.574250+0000", 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.4154201180000001, 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020359848999999999, 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99338 2023-07-29T16:39:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574250+0000", 2023-07-29T16:39:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574250+0000", 2023-07-29T16:39:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574249+0000", 2023-07-29T16:39:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574313+0000", 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3670000000000005e-05 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574322+0000", 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0129999999999999e-06 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.574329+0000", 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6529999999999997e-06 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.576341+0000", 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020120350000000001 2023-07-29T16:39:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.576482+0000", 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141094 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.594499+0000", 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018016958999999999 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.594558+0000", 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8906999999999997e-05 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.594610+0000", 2023-07-29T16:39:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2439999999999999e-05 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.305048169, 2023-07-29T16:39:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:105886 5.0 5:0744161a:::benchmark_data_smithi070_97781_object105885:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.346682+0000", 2023-07-29T16:39:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.64298788900000003, 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020222976, 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 105886 2023-07-29T16:39:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346682+0000", 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346682+0000", 2023-07-29T16:39:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346681+0000", 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346740+0000", 2023-07-29T16:39:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8841999999999997e-05 2023-07-29T16:39:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346753+0000", 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2544999999999999e-05 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.346761+0000", 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.585e-06 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.353606+0000", 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068447969999999997 2023-07-29T16:39:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.353697+0000", 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0684000000000001e-05 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.366790+0000", 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013092866 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.366833+0000", 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.384e-05 2023-07-29T16:39:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.366905+0000", 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1866999999999995e-05 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:106043 5.4 5:29fff88a:::benchmark_data_smithi070_97781_object106042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.56913125399999998, 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020528363000000001, 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 106043 2023-07-29T16:39:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420539+0000", 2023-07-29T16:39:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420564+0000", 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5885999999999999e-05 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420573+0000", 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1769999999999998e-06 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.420578+0000", 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7919999999999998e-06 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.428893+0000", 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083148809999999997 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.429002+0000", 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108243 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.440946+0000", 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011944939999999999 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.440996+0000", 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0006999999999997e-05 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:00.441067+0000", 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0910999999999999e-05 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:01.238 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:01.238 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 45 16 107667 107651 149.503 154.438 0.00701959 0.0066864 2023-07-29T16:39:01.239 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:01.237+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:01.240 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:01.340 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:01.338+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:01.425 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108494 5.f 5:f3115252:::benchmark_data_smithi070_97781_object108493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.419914+0000", 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003287941, 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0033159859999999999, 2023-07-29T16:39:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108494 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.427 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419914+0000", 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419914+0000", 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419913+0000", 2023-07-29T16:39:01.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419975+0000", 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1952000000000006e-05 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419985+0000", 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0638999999999999e-05 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.419993+0000", 2023-07-29T16:39:01.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4490000000000002e-06 2023-07-29T16:39:01.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420034+0000", 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0970999999999998e-05 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420155+0000", 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121215 2023-07-29T16:39:01.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:01.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420327+0000", 2023-07-29T16:39:01.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017198699999999999 2023-07-29T16:39:01.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.435 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.435 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108496 5.3 5:c2a5a68a:::benchmark_data_smithi070_97781_object108495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.420029+0000", 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003172416, 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032743949999999998, 2023-07-29T16:39:01.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108496 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420029+0000", 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420029+0000", 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420029+0000", 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420087+0000", 2023-07-29T16:39:01.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8882000000000003e-05 2023-07-29T16:39:01.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420095+0000", 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9310000000000008e-06 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420102+0000", 2023-07-29T16:39:01.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.207e-06 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420140+0000", 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8439999999999998e-05 2023-07-29T16:39:01.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420296+0000", 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015565899999999999 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.443 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108498 5.f 5:f6c4cb8f:::benchmark_data_smithi070_97781_object108497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.420215+0000", 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0029870919999999998, 2023-07-29T16:39:01.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00316796, 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108498 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.445 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420215+0000", 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420215+0000", 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420214+0000", 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420268+0000", 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3647000000000003e-05 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420274+0000", 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.742e-06 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420280+0000", 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3530000000000002e-06 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.423101+0000", 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002821545 2023-07-29T16:39:01.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.423244+0000", 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014222799999999999 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.452 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108499 5.3 5:c976cabf:::benchmark_data_smithi070_97781_object108498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.452 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.420882+0000", 2023-07-29T16:39:01.452 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002319471, 2023-07-29T16:39:01.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025729199999999998, 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108499 2023-07-29T16:39:01.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420882+0000", 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420882+0000", 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420881+0000", 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420949+0000", 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7745999999999998e-05 2023-07-29T16:39:01.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420959+0000", 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0197000000000001e-05 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.420967+0000", 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6639999999999998e-06 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422552+0000", 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015850759999999999 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422702+0000", 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149803 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108500 5.f 5.1c0183df (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.421707+0000", 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0014942779999999999, 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018095679999999999, 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.460 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108500 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421707+0000", 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421707+0000", 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421707+0000", 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421780+0000", 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2862999999999997e-05 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421791+0000", 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1021e-05 2023-07-29T16:39:01.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421798+0000", 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1380000000000001e-06 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108501 5.5 5:a85461ec:::benchmark_data_smithi070_97781_object108500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.421807+0000", 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001395196, 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00174523, 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:01.466 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108501 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421807+0000", 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421807+0000", 2023-07-29T16:39:01.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421806+0000", 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421839+0000", 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2787999999999998e-05 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421858+0000", 2023-07-29T16:39:01.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9313e-05 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421867+0000", 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6829999999999997e-06 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421904+0000", 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7387e-05 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422013+0000", 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109306 2023-07-29T16:39:01.472 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108502 5.5 5.51b13025 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.421884+0000", 2023-07-29T16:39:01.473 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001318112, 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001703455, 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108502 2023-07-29T16:39:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421884+0000", 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421884+0000", 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421883+0000", 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421907+0000", 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4443999999999998e-05 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421915+0000", 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1009999999999992e-06 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.421921+0000", 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.801e-06 2023-07-29T16:39:01.478 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:108504 5.7 5.10a948b7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:01.422443+0000", 2023-07-29T16:39:01.479 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00075859500000000004, 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00117468, 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 108504 2023-07-29T16:39:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422443+0000", 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422443+0000", 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422442+0000", 2023-07-29T16:39:01.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422503+0000", 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1027999999999999e-05 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422513+0000", 2023-07-29T16:39:01.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8349999999999999e-06 2023-07-29T16:39:01.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:01.422521+0000", 2023-07-29T16:39:01.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6690000000000006e-06 2023-07-29T16:39:01.485 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.485 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.486 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.486 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.486 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:01.486 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 8 2023-07-29T16:39:01.486 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:01.487 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:01.485+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:01.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:01.588 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:01.586+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:01.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:39:01.673 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:01.674 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:01.674 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:01.674 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:01.674 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:01.689 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:01.686+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:01.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:01.789 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:01.788+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:01.890 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:01.888+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:01.911 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:01.912 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 79.386512749999994, 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:01.913 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:01.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:01.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.924 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 67.961418151000004, 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:01.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:01.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:01.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:01.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:01.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 67.961158381999994, 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:01.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:01.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:01.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 67.961087512000006, 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:01.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:01.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:01.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:01.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.956 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.8652301589999993, 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.957 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:01.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:01.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:01.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:01.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.966 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.8330827860000003, 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:01.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:01.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:01.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:01.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:01.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7107806550000006, 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.978 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:01.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:01.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:01.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:01.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:01.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:01.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:01.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:01.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:01.990 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:01.991 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4933087809999996, 2023-07-29T16:39:01.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:01.991 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:01.991 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:01.991 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:01.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:01.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:01.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:01.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:01.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:01.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:01.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:02.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:02.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:02.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:02.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:02.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:02.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:02.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.004 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.005 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.005 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:02.006 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4907883689999997, 2023-07-29T16:39:02.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:02.006 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.007 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.007 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.008 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:02.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.008 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:02.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:02.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:02.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:02.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:02.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:02.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:02.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:02.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:02.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:02.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4906666230000001, 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.021 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:02.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:02.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:02.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:02.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:02.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:02.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:02.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:02.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:02.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:02.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:02.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:02.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:02.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:02.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:02.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:02.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.036 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4904246580000002, 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:02.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:02.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:02.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:02.047 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.048 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.048 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.049 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.049 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:02.049 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.490274404, 2023-07-29T16:39:02.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:02.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:02.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.051 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:02.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:02.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:02.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:02.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:02.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:02.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:02.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:02.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:02.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:02.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:02.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:02.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4901960079999998, 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:02.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:02.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:02.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:02.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4901515319999996, 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.076 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:02.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:02.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:02.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:02.085 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.489706398, 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:02.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:02.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:02.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4896202499999998, 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:02.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:02.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:02.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:02.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:02.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:02.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:02.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:02.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:02.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:02.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:02.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:02.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:02.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:02.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:02.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.109 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.110 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.110 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:02.111 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.488620107, 2023-07-29T16:39:02.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:02.111 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.111 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.111 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.112 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:02.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.113 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:02.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:02.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:02.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:02.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4882862939999999, 2023-07-29T16:39:02.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.123 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:02.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:02.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:02.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:02.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:02.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:02.132 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:02.133 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4835757599999999, 2023-07-29T16:39:02.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:02.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:02.134 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:02.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:02.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:02.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:02.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:02.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.4832644989999997, 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:02.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.144 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:02.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:02.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:02.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:02.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:02.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:02.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:02.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:02.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:02.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:02.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:02.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:02.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:02.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.155 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.155 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:02.156 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:02.156 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:02.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:02.159 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 46 16 110100 110084 149.558 152.062 0.00349167 0.00668409 2023-07-29T16:39:02.160 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.156+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:02.209 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-07-29T16:39:02.209 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:39:02.209 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-07-29T16:39:02.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:39:02.259 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:02.257+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:02.336 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:02.336 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:02.350 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:02.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:02.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:02.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:02.353 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:02.354 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:02.355 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:02.360 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.359+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.462 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.460+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.560 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:02.561 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:02.563 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.561+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.567 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:39:02.568 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:39:02.568 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 44, 2023-07-29T16:39:02.568 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:39:02.568 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:39:02.568 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:38:59.570816+0000", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:38:52.552792+0000", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5799936, 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:39:02.569 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:39:02.570 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 5, 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:39:02.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:02.572 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:02.573 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:02.574 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:39:02.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:02.576 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:02.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:02.578 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:02.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:02.580 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.581 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:02.582 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:39:02.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:02.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:02.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:02.584 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:02.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:02.584 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:02.585 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:02.586 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:02.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:02.588 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:02.589 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:02.590 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:02.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:02.592 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.4900000095367432, 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.4900000095367432, 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:02.593 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1, 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1, 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:02.596 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:02.597 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:02.598 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:02.599 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:02.600 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:02.601 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:02.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:02.603 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:02.604 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.690000057220459, 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.690000057220459, 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:02.605 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.606 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:02.607 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:02.608 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:02.609 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:02.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:02.611 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:02.612 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:02.613 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:02.614 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:02.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.616 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5399999618530273, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5399999618530273, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.0299999713897705, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.0299999713897705, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:02.617 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "unique_pool_0", 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:38:13.069639+0000", 2023-07-29T16:39:02.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:02.619 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 16, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 16, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 16, 2023-07-29T16:39:02.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 16, 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 16, 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:02.622 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:02.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:02.626 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: "rados": {} 2023-07-29T16:39:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.690000057220459, 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.690000057220459, 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:39:02.628 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:02.629 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:02.630 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 41, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:02.631 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:39:02.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.637 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:02.639 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:39:02.640 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 41, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:39:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:39:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 0, 2023-07-29T16:39:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:39:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 41, 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.653 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:02.655 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.656 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:02.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:02.659 INFO:teuthology.orchestra.run.smithi070.stdout: "exists" 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:39:02.660 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:39:02.662 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:02.663 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 40 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:02.664 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "4.19", 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: 1, 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:39:02.665 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:39:02.666 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:39:02.667 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:39:02.668 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:39:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:39:02.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:02.669 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:39:02.670 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.668+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:02.672 INFO:tasks.thrashosds.thrasher:j is {'epoch': 44, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:38:59.570816+0000', 'last_up_change': '2023-07-29T16:38:52.552792+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-07-29T16:38:13.069639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 40}], 'pg_upmap': [{'pgid': '4.19', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:39:02.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:39:02.674 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:39:02.771 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.769+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.849 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:02.849 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:02.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:02.910 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:02.908+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:02.973 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:02.971+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:03.046 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:03.047 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:03.053 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:39:03.059 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-07-29T16:39:03.062 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:03.067 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-07-29T16:39:02.576959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6971788122,"num_objects":106396,"num_object_clones":0,"num_object_copies":212792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86495,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106396,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":106620,"num_write_kb":6811282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61946,"ondisk_log_size":61946,"up":157,"acting":157,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1102712,"kb_used_data":780700,"kb_used_omap":0,"kb_used_meta":321984,"kb_avail":282012808,"statfs":{"total":289910292480,"available":288781115392,"internally_reserved":0,"allocated":799436800,"data_stored":12767974937,"data_compressed":61171598,"data_compressed_allocated":797966336,"data_compressed_original":12767428608,"omap_allocated":0,"internal_metadata":329711616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1316552704,"num_objects":20089,"num_object_clones":0,"num_object_copies":40178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86495,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20089,"num_write_kb":1285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.105458"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576141+0000","last_change":"2023-07-29T16:38:53.574682+0000","last_active":"2023-07-29T16:38:56.576141+0000","last_peered":"2023-07-29T16:38:56.576141+0000","last_clean":"2023-07-29T16:38:50.560290+0000","last_became_active":"2023-07-29T16:38:53.574682+0000","last_became_peered":"2023-07-29T16:38:53.574682+0000","last_unstale":"2023-07-29T16:38:56.576141+0000","last_undegraded":"2023-07-29T16:38:56.576141+0000","last_fullsized":"2023-07-29T16:38:53.566488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:42:05.621610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575877+0000","last_change":"2023-07-29T16:38:53.569386+0000","last_active":"2023-07-29T16:38:56.575877+0000","last_peered":"2023-07-29T16:38:56.575877+0000","last_clean":"2023-07-29T16:38:50.558915+0000","last_became_active":"2023-07-29T16:38:53.569386+0000","last_became_peered":"2023-07-29T16:38:53.569386+0000","last_unstale":"2023-07-29T16:38:56.575877+0000","last_undegraded":"2023-07-29T16:38:56.575877+0000","last_fullsized":"2023-07-29T16:38:53.566023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:35:21.029799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571573+0000","last_change":"2023-07-29T16:37:53.965140+0000","last_active":"2023-07-29T16:38:56.571573+0000","last_peered":"2023-07-29T16:38:56.571573+0000","last_clean":"2023-07-29T16:38:56.571573+0000","last_became_active":"2023-07-29T16:37:53.964531+0000","last_became_peered":"2023-07-29T16:37:53.964531+0000","last_unstale":"2023-07-29T16:38:56.571573+0000","last_undegraded":"2023-07-29T16:38:56.571573+0000","last_fullsized":"2023-07-29T16:38:56.571573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:59:02.233307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572587+0000","last_change":"2023-07-29T16:38:53.576068+0000","last_active":"2023-07-29T16:38:56.572587+0000","last_peered":"2023-07-29T16:38:56.572587+0000","last_clean":"2023-07-29T16:38:50.560587+0000","last_became_active":"2023-07-29T16:38:53.576068+0000","last_became_peered":"2023-07-29T16:38:53.576068+0000","last_unstale":"2023-07-29T16:38:56.572587+0000","last_undegraded":"2023-07-29T16:38:56.572587+0000","last_fullsized":"2023-07-29T16:38:53.565315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:20:44.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575029+0000","last_change":"2023-07-29T16:38:53.574037+0000","last_active":"2023-07-29T16:38:56.575029+0000","last_peered":"2023-07-29T16:38:56.575029+0000","last_clean":"2023-07-29T16:38:50.558735+0000","last_became_active":"2023-07-29T16:38:53.574037+0000","last_became_peered":"2023-07-29T16:38:53.574037+0000","last_unstale":"2023-07-29T16:38:56.575029+0000","last_undegraded":"2023-07-29T16:38:56.575029+0000","last_fullsized":"2023-07-29T16:38:53.567265+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:48:45.622880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574918+0000","last_change":"2023-07-29T16:38:53.574318+0000","last_active":"2023-07-29T16:38:56.574918+0000","last_peered":"2023-07-29T16:38:56.574918+0000","last_clean":"2023-07-29T16:38:50.560855+0000","last_became_active":"2023-07-29T16:38:53.574318+0000","last_became_peered":"2023-07-29T16:38:53.574318+0000","last_unstale":"2023-07-29T16:38:56.574918+0000","last_undegraded":"2023-07-29T16:38:56.574918+0000","last_fullsized":"2023-07-29T16:38:53.565817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:35:37.098257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571953+0000","last_change":"2023-07-29T16:38:53.573045+0000","last_active":"2023-07-29T16:38:56.571953+0000","last_peered":"2023-07-29T16:38:56.571953+0000","last_clean":"2023-07-29T16:38:50.560467+0000","last_became_active":"2023-07-29T16:38:53.573045+0000","last_became_peered":"2023-07-29T16:38:53.573045+0000","last_unstale":"2023-07-29T16:38:56.571953+0000","last_undegraded":"2023-07-29T16:38:56.571953+0000","last_fullsized":"2023-07-29T16:38:53.564779+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:23:00.715161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.570924+0000","last_change":"2023-07-29T16:38:53.565845+0000","last_active":"2023-07-29T16:38:56.570924+0000","last_peered":"2023-07-29T16:38:56.570924+0000","last_clean":"2023-07-29T16:38:50.559863+0000","last_became_active":"2023-07-29T16:38:53.565845+0000","last_became_peered":"2023-07-29T16:38:53.565845+0000","last_unstale":"2023-07-29T16:38:56.570924+0000","last_undegraded":"2023-07-29T16:38:56.570924+0000","last_fullsized":"2023-07-29T16:38:53.562853+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:18:28.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576072+0000","last_change":"2023-07-29T16:38:53.574343+0000","last_active":"2023-07-29T16:38:56.576072+0000","last_peered":"2023-07-29T16:38:56.576072+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.574343+0000","last_became_peered":"2023-07-29T16:38:53.574343+0000","last_unstale":"2023-07-29T16:38:56.576072+0000","last_undegraded":"2023-07-29T16:38:56.576072+0000","last_fullsized":"2023-07-29T16:38:53.566258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:33:58.334614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576402+0000","last_change":"2023-07-29T16:38:53.571328+0000","last_active":"2023-07-29T16:38:56.576402+0000","last_peered":"2023-07-29T16:38:56.576402+0000","last_clean":"2023-07-29T16:38:50.559246+0000","last_became_active":"2023-07-29T16:38:53.571328+0000","last_became_peered":"2023-07-29T16:38:53.571328+0000","last_unstale":"2023-07-29T16:38:56.576402+0000","last_undegraded":"2023-07-29T16:38:56.576402+0000","last_fullsized":"2023-07-29T16:38:53.566833+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:15:04.328567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571513+0000","last_change":"2023-07-29T16:38:53.572540+0000","last_active":"2023-07-29T16:38:56.571513+0000","last_peered":"2023-07-29T16:38:56.571513+0000","last_clean":"2023-07-29T16:38:50.560550+0000","last_became_active":"2023-07-29T16:38:53.572540+0000","last_became_peered":"2023-07-29T16:38:53.572540+0000","last_unstale":"2023-07-29T16:38:56.571513+0000","last_undegraded":"2023-07-29T16:38:56.571513+0000","last_fullsized":"2023-07-29T16:38:53.564620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:39:24.618607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575174+0000","last_change":"2023-07-29T16:37:53.957626+0000","last_active":"2023-07-29T16:38:56.575174+0000","last_peered":"2023-07-29T16:38:56.575174+0000","last_clean":"2023-07-29T16:38:56.575174+0000","last_became_active":"2023-07-29T16:37:53.956336+0000","last_became_peered":"2023-07-29T16:37:53.956336+0000","last_unstale":"2023-07-29T16:38:56.575174+0000","last_undegraded":"2023-07-29T16:38:56.575174+0000","last_fullsized":"2023-07-29T16:38:56.575174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575217+0000","last_change":"2023-07-29T16:38:53.574801+0000","last_active":"2023-07-29T16:38:56.575217+0000","last_peered":"2023-07-29T16:38:56.575217+0000","last_clean":"2023-07-29T16:38:50.558984+0000","last_became_active":"2023-07-29T16:38:53.574801+0000","last_became_peered":"2023-07-29T16:38:53.574801+0000","last_unstale":"2023-07-29T16:38:56.575217+0000","last_undegraded":"2023-07-29T16:38:56.575217+0000","last_fullsized":"2023-07-29T16:38:53.568400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:04:42.962308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574832+0000","last_change":"2023-07-29T16:37:53.962183+0000","last_active":"2023-07-29T16:38:56.574832+0000","last_peered":"2023-07-29T16:38:56.574832+0000","last_clean":"2023-07-29T16:38:56.574832+0000","last_became_active":"2023-07-29T16:37:53.961464+0000","last_became_peered":"2023-07-29T16:37:53.961464+0000","last_unstale":"2023-07-29T16:38:56.574832+0000","last_undegraded":"2023-07-29T16:38:56.574832+0000","last_fullsized":"2023-07-29T16:38:56.574832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571674+0000","last_change":"2023-07-29T16:37:53.960809+0000","last_active":"2023-07-29T16:38:56.571674+0000","last_peered":"2023-07-29T16:38:56.571674+0000","last_clean":"2023-07-29T16:38:56.571674+0000","last_became_active":"2023-07-29T16:37:53.960333+0000","last_became_peered":"2023-07-29T16:37:53.960333+0000","last_unstale":"2023-07-29T16:38:56.571674+0000","last_undegraded":"2023-07-29T16:38:56.571674+0000","last_fullsized":"2023-07-29T16:38:56.571674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571449+0000","last_change":"2023-07-29T16:38:53.567804+0000","last_active":"2023-07-29T16:38:56.571449+0000","last_peered":"2023-07-29T16:38:56.571449+0000","last_clean":"2023-07-29T16:38:50.560243+0000","last_became_active":"2023-07-29T16:38:53.567804+0000","last_became_peered":"2023-07-29T16:38:53.567804+0000","last_unstale":"2023-07-29T16:38:56.571449+0000","last_undegraded":"2023-07-29T16:38:56.571449+0000","last_fullsized":"2023-07-29T16:38:53.564093+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:20:31.181017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576021+0000","last_change":"2023-07-29T16:38:53.574364+0000","last_active":"2023-07-29T16:38:56.576021+0000","last_peered":"2023-07-29T16:38:56.576021+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.574364+0000","last_became_peered":"2023-07-29T16:38:53.574364+0000","last_unstale":"2023-07-29T16:38:56.576021+0000","last_undegraded":"2023-07-29T16:38:56.576021+0000","last_fullsized":"2023-07-29T16:38:53.566315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:22:09.587275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576303+0000","last_change":"2023-07-29T16:38:53.571160+0000","last_active":"2023-07-29T16:38:56.576303+0000","last_peered":"2023-07-29T16:38:56.576303+0000","last_clean":"2023-07-29T16:38:50.559181+0000","last_became_active":"2023-07-29T16:38:53.571160+0000","last_became_peered":"2023-07-29T16:38:53.571160+0000","last_unstale":"2023-07-29T16:38:56.576303+0000","last_undegraded":"2023-07-29T16:38:56.576303+0000","last_fullsized":"2023-07-29T16:38:53.566622+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:14:17.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575990+0000","last_change":"2023-07-29T16:38:53.571917+0000","last_active":"2023-07-29T16:38:56.575990+0000","last_peered":"2023-07-29T16:38:56.575990+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.571917+0000","last_became_peered":"2023-07-29T16:38:53.571917+0000","last_unstale":"2023-07-29T16:38:56.575990+0000","last_undegraded":"2023-07-29T16:38:56.575990+0000","last_fullsized":"2023-07-29T16:38:53.567914+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:04:29.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572454+0000","last_change":"2023-07-29T16:38:53.575840+0000","last_active":"2023-07-29T16:38:56.572454+0000","last_peered":"2023-07-29T16:38:56.572454+0000","last_clean":"2023-07-29T16:38:50.560504+0000","last_became_active":"2023-07-29T16:38:53.575840+0000","last_became_peered":"2023-07-29T16:38:53.575840+0000","last_unstale":"2023-07-29T16:38:56.572454+0000","last_undegraded":"2023-07-29T16:38:56.572454+0000","last_fullsized":"2023-07-29T16:38:53.564395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:16:35.398973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572802+0000","last_change":"2023-07-29T16:38:53.575757+0000","last_active":"2023-07-29T16:38:56.572802+0000","last_peered":"2023-07-29T16:38:56.572802+0000","last_clean":"2023-07-29T16:38:50.560856+0000","last_became_active":"2023-07-29T16:38:53.575757+0000","last_became_peered":"2023-07-29T16:38:53.575757+0000","last_unstale":"2023-07-29T16:38:56.572802+0000","last_undegraded":"2023-07-29T16:38:56.572802+0000","last_fullsized":"2023-07-29T16:38:53.566640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:18:09.626072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575132+0000","last_change":"2023-07-29T16:37:53.958481+0000","last_active":"2023-07-29T16:38:56.575132+0000","last_peered":"2023-07-29T16:38:56.575132+0000","last_clean":"2023-07-29T16:38:56.575132+0000","last_became_active":"2023-07-29T16:37:53.957147+0000","last_became_peered":"2023-07-29T16:37:53.957147+0000","last_unstale":"2023-07-29T16:38:56.575132+0000","last_undegraded":"2023-07-29T16:38:56.575132+0000","last_fullsized":"2023-07-29T16:38:56.575132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:34:31.106566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571819+0000","last_change":"2023-07-29T16:38:53.570395+0000","last_active":"2023-07-29T16:38:56.571819+0000","last_peered":"2023-07-29T16:38:56.571819+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.570395+0000","last_became_peered":"2023-07-29T16:38:53.570395+0000","last_unstale":"2023-07-29T16:38:56.571819+0000","last_undegraded":"2023-07-29T16:38:56.571819+0000","last_fullsized":"2023-07-29T16:38:53.564395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:14.133084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574715+0000","last_change":"2023-07-29T16:38:53.571915+0000","last_active":"2023-07-29T16:38:56.574715+0000","last_peered":"2023-07-29T16:38:56.574715+0000","last_clean":"2023-07-29T16:38:50.560173+0000","last_became_active":"2023-07-29T16:38:53.571915+0000","last_became_peered":"2023-07-29T16:38:53.571915+0000","last_unstale":"2023-07-29T16:38:56.574715+0000","last_undegraded":"2023-07-29T16:38:56.574715+0000","last_fullsized":"2023-07-29T16:38:53.565790+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:43:59.227945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.580080+0000","last_change":"2023-07-29T16:37:53.957505+0000","last_active":"2023-07-29T16:38:56.580080+0000","last_peered":"2023-07-29T16:38:56.580080+0000","last_clean":"2023-07-29T16:38:56.580080+0000","last_became_active":"2023-07-29T16:37:53.955739+0000","last_became_peered":"2023-07-29T16:37:53.955739+0000","last_unstale":"2023-07-29T16:38:56.580080+0000","last_undegraded":"2023-07-29T16:38:56.580080+0000","last_fullsized":"2023-07-29T16:38:56.580080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:55.451825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572611+0000","last_change":"2023-07-29T16:38:53.578022+0000","last_active":"2023-07-29T16:38:56.572611+0000","last_peered":"2023-07-29T16:38:56.572611+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.578022+0000","last_became_peered":"2023-07-29T16:38:53.578022+0000","last_unstale":"2023-07-29T16:38:56.572611+0000","last_undegraded":"2023-07-29T16:38:56.572611+0000","last_fullsized":"2023-07-29T16:38:53.567093+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:49:02.180125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571943+0000","last_change":"2023-07-29T16:37:53.962917+0000","last_active":"2023-07-29T16:38:56.571943+0000","last_peered":"2023-07-29T16:38:56.571943+0000","last_clean":"2023-07-29T16:38:56.571943+0000","last_became_active":"2023-07-29T16:37:53.962089+0000","last_became_peered":"2023-07-29T16:37:53.962089+0000","last_unstale":"2023-07-29T16:38:56.571943+0000","last_undegraded":"2023-07-29T16:38:56.571943+0000","last_fullsized":"2023-07-29T16:38:56.571943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:36:47.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":43,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575496+0000","last_change":"2023-07-29T16:38:53.571857+0000","last_active":"2023-07-29T16:38:56.575496+0000","last_peered":"2023-07-29T16:38:56.575496+0000","last_clean":"2023-07-29T16:38:50.560268+0000","last_became_active":"2023-07-29T16:38:53.571857+0000","last_became_peered":"2023-07-29T16:38:53.571857+0000","last_unstale":"2023-07-29T16:38:56.575496+0000","last_undegraded":"2023-07-29T16:38:56.575496+0000","last_fullsized":"2023-07-29T16:38:53.567251+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:35:01.853701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575470+0000","last_change":"2023-07-29T16:37:53.959825+0000","last_active":"2023-07-29T16:38:56.575470+0000","last_peered":"2023-07-29T16:38:56.575470+0000","last_clean":"2023-07-29T16:38:56.575470+0000","last_became_active":"2023-07-29T16:37:53.959360+0000","last_became_peered":"2023-07-29T16:37:53.959360+0000","last_unstale":"2023-07-29T16:38:56.575470+0000","last_undegraded":"2023-07-29T16:38:56.575470+0000","last_fullsized":"2023-07-29T16:38:56.575470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:04:26.818349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571444+0000","last_change":"2023-07-29T16:38:53.570159+0000","last_active":"2023-07-29T16:38:56.571444+0000","last_peered":"2023-07-29T16:38:56.571444+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.570159+0000","last_became_peered":"2023-07-29T16:38:53.570159+0000","last_unstale":"2023-07-29T16:38:56.571444+0000","last_undegraded":"2023-07-29T16:38:56.571444+0000","last_fullsized":"2023-07-29T16:38:53.563458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:42:36.125168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572441+0000","last_change":"2023-07-29T16:38:53.577901+0000","last_active":"2023-07-29T16:38:56.572441+0000","last_peered":"2023-07-29T16:38:56.572441+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.577901+0000","last_became_peered":"2023-07-29T16:38:53.577901+0000","last_unstale":"2023-07-29T16:38:56.572441+0000","last_undegraded":"2023-07-29T16:38:56.572441+0000","last_fullsized":"2023-07-29T16:38:53.566938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:05:34.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574732+0000","last_change":"2023-07-29T16:38:53.572775+0000","last_active":"2023-07-29T16:38:56.574732+0000","last_peered":"2023-07-29T16:38:56.574732+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.572775+0000","last_became_peered":"2023-07-29T16:38:53.572775+0000","last_unstale":"2023-07-29T16:38:56.574732+0000","last_undegraded":"2023-07-29T16:38:56.574732+0000","last_fullsized":"2023-07-29T16:38:53.565441+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:51:44.362630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.580033+0000","last_change":"2023-07-29T16:37:53.958552+0000","last_active":"2023-07-29T16:38:56.580033+0000","last_peered":"2023-07-29T16:38:56.580033+0000","last_clean":"2023-07-29T16:38:56.580033+0000","last_became_active":"2023-07-29T16:37:53.957265+0000","last_became_peered":"2023-07-29T16:37:53.957265+0000","last_unstale":"2023-07-29T16:38:56.580033+0000","last_undegraded":"2023-07-29T16:38:56.580033+0000","last_fullsized":"2023-07-29T16:38:56.580033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:08:16.883340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574084+0000","last_change":"2023-07-29T16:38:53.577320+0000","last_active":"2023-07-29T16:38:56.574084+0000","last_peered":"2023-07-29T16:38:56.574084+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.577320+0000","last_became_peered":"2023-07-29T16:38:53.577320+0000","last_unstale":"2023-07-29T16:38:56.574084+0000","last_undegraded":"2023-07-29T16:38:56.574084+0000","last_fullsized":"2023-07-29T16:38:53.565413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:55:40.142769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574866+0000","last_change":"2023-07-29T16:38:53.572132+0000","last_active":"2023-07-29T16:38:56.574866+0000","last_peered":"2023-07-29T16:38:56.574866+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.572132+0000","last_became_peered":"2023-07-29T16:38:53.572132+0000","last_unstale":"2023-07-29T16:38:56.574866+0000","last_undegraded":"2023-07-29T16:38:56.574866+0000","last_fullsized":"2023-07-29T16:38:53.566346+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:18:36.616187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572252+0000","last_change":"2023-07-29T16:38:53.577773+0000","last_active":"2023-07-29T16:38:56.572252+0000","last_peered":"2023-07-29T16:38:56.572252+0000","last_clean":"2023-07-29T16:38:50.562754+0000","last_became_active":"2023-07-29T16:38:53.577773+0000","last_became_peered":"2023-07-29T16:38:53.577773+0000","last_unstale":"2023-07-29T16:38:56.572252+0000","last_undegraded":"2023-07-29T16:38:56.572252+0000","last_fullsized":"2023-07-29T16:38:53.565557+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:55:25.552474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571330+0000","last_change":"2023-07-29T16:38:53.569666+0000","last_active":"2023-07-29T16:38:56.571330+0000","last_peered":"2023-07-29T16:38:56.571330+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.569666+0000","last_became_peered":"2023-07-29T16:38:53.569666+0000","last_unstale":"2023-07-29T16:38:56.571330+0000","last_undegraded":"2023-07-29T16:38:56.571330+0000","last_fullsized":"2023-07-29T16:38:53.563390+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:38:45.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575583+0000","last_change":"2023-07-29T16:37:53.569650+0000","last_active":"2023-07-29T16:38:56.575583+0000","last_peered":"2023-07-29T16:38:56.575583+0000","last_clean":"2023-07-29T16:38:56.575583+0000","last_became_active":"2023-07-29T16:37:53.569370+0000","last_became_peered":"2023-07-29T16:37:53.569370+0000","last_unstale":"2023-07-29T16:38:56.575583+0000","last_undegraded":"2023-07-29T16:38:56.575583+0000","last_fullsized":"2023-07-29T16:38:56.575583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574911+0000","last_change":"2023-07-29T16:38:53.573884+0000","last_active":"2023-07-29T16:38:56.574911+0000","last_peered":"2023-07-29T16:38:56.574911+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.573884+0000","last_became_peered":"2023-07-29T16:38:53.573884+0000","last_unstale":"2023-07-29T16:38:56.574911+0000","last_undegraded":"2023-07-29T16:38:56.574911+0000","last_fullsized":"2023-07-29T16:38:53.565684+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:07.689077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.572348+0000","last_change":"2023-07-29T16:37:53.566737+0000","last_active":"2023-07-29T16:38:56.572348+0000","last_peered":"2023-07-29T16:38:56.572348+0000","last_clean":"2023-07-29T16:38:56.572348+0000","last_became_active":"2023-07-29T16:37:53.565725+0000","last_became_peered":"2023-07-29T16:37:53.565725+0000","last_unstale":"2023-07-29T16:38:56.572348+0000","last_undegraded":"2023-07-29T16:38:56.572348+0000","last_fullsized":"2023-07-29T16:38:56.572348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:22:32.276943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.572605+0000","last_change":"2023-07-29T16:37:53.961358+0000","last_active":"2023-07-29T16:38:56.572605+0000","last_peered":"2023-07-29T16:38:56.572605+0000","last_clean":"2023-07-29T16:38:56.572605+0000","last_became_active":"2023-07-29T16:37:53.960476+0000","last_became_peered":"2023-07-29T16:37:53.960476+0000","last_unstale":"2023-07-29T16:38:56.572605+0000","last_undegraded":"2023-07-29T16:38:56.572605+0000","last_fullsized":"2023-07-29T16:38:56.572605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":44,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.572373+0000","last_change":"2023-07-29T16:38:53.573381+0000","last_active":"2023-07-29T16:38:56.572373+0000","last_peered":"2023-07-29T16:38:56.572373+0000","last_clean":"2023-07-29T16:38:50.560589+0000","last_became_active":"2023-07-29T16:38:53.573381+0000","last_became_peered":"2023-07-29T16:38:53.573381+0000","last_unstale":"2023-07-29T16:38:56.572373+0000","last_undegraded":"2023-07-29T16:38:53.565685+0000","last_fullsized":"2023-07-29T16:38:53.565427+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:47:47.444434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575740+0000","last_change":"2023-07-29T16:38:53.569662+0000","last_active":"2023-07-29T16:38:56.575740+0000","last_peered":"2023-07-29T16:38:56.575740+0000","last_clean":"2023-07-29T16:38:50.560860+0000","last_became_active":"2023-07-29T16:38:53.569662+0000","last_became_peered":"2023-07-29T16:38:53.569662+0000","last_unstale":"2023-07-29T16:38:56.575740+0000","last_undegraded":"2023-07-29T16:38:56.575740+0000","last_fullsized":"2023-07-29T16:38:53.566267+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:43.497590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574584+0000","last_change":"2023-07-29T16:38:53.573851+0000","last_active":"2023-07-29T16:38:56.574584+0000","last_peered":"2023-07-29T16:38:56.574584+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.573851+0000","last_became_peered":"2023-07-29T16:38:53.573851+0000","last_unstale":"2023-07-29T16:38:56.574584+0000","last_undegraded":"2023-07-29T16:38:56.574584+0000","last_fullsized":"2023-07-29T16:38:53.564014+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:22:51.395842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575512+0000","last_change":"2023-07-29T16:38:53.571894+0000","last_active":"2023-07-29T16:38:56.575512+0000","last_peered":"2023-07-29T16:38:56.575512+0000","last_clean":"2023-07-29T16:38:50.559305+0000","last_became_active":"2023-07-29T16:38:53.571894+0000","last_became_peered":"2023-07-29T16:38:53.571894+0000","last_unstale":"2023-07-29T16:38:56.575512+0000","last_undegraded":"2023-07-29T16:38:56.575512+0000","last_fullsized":"2023-07-29T16:38:53.567556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:34:42.305554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574701+0000","last_change":"2023-07-29T16:37:53.567963+0000","last_active":"2023-07-29T16:38:56.574701+0000","last_peered":"2023-07-29T16:38:56.574701+0000","last_clean":"2023-07-29T16:38:56.574701+0000","last_became_active":"2023-07-29T16:37:53.567659+0000","last_became_peered":"2023-07-29T16:37:53.567659+0000","last_unstale":"2023-07-29T16:38:56.574701+0000","last_undegraded":"2023-07-29T16:38:56.574701+0000","last_fullsized":"2023-07-29T16:38:56.574701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:04:49.122421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571884+0000","last_change":"2023-07-29T16:38:53.577287+0000","last_active":"2023-07-29T16:38:56.571884+0000","last_peered":"2023-07-29T16:38:56.571884+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.577287+0000","last_became_peered":"2023-07-29T16:38:53.577287+0000","last_unstale":"2023-07-29T16:38:56.571884+0000","last_undegraded":"2023-07-29T16:38:56.571884+0000","last_fullsized":"2023-07-29T16:38:53.564245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:06:21.518553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571797+0000","last_change":"2023-07-29T16:37:53.565815+0000","last_active":"2023-07-29T16:38:56.571797+0000","last_peered":"2023-07-29T16:38:56.571797+0000","last_clean":"2023-07-29T16:38:56.571797+0000","last_became_active":"2023-07-29T16:37:53.565030+0000","last_became_peered":"2023-07-29T16:37:53.565030+0000","last_unstale":"2023-07-29T16:38:56.571797+0000","last_undegraded":"2023-07-29T16:38:56.571797+0000","last_fullsized":"2023-07-29T16:38:56.571797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:39:21.626000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.573867+0000","last_change":"2023-07-29T16:38:53.577275+0000","last_active":"2023-07-29T16:38:56.573867+0000","last_peered":"2023-07-29T16:38:56.573867+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.577275+0000","last_became_peered":"2023-07-29T16:38:53.577275+0000","last_unstale":"2023-07-29T16:38:56.573867+0000","last_undegraded":"2023-07-29T16:38:56.573867+0000","last_fullsized":"2023-07-29T16:38:53.564583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:59:57.256177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"44'6663","reported_seq":6695,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-29T16:39:00.554414+0000","last_change":"2023-07-29T16:38:15.000885+0000","last_active":"2023-07-29T16:39:00.554414+0000","last_peered":"2023-07-29T16:39:00.554414+0000","last_clean":"2023-07-29T16:39:00.554414+0000","last_became_active":"2023-07-29T16:38:15.000700+0000","last_became_peered":"2023-07-29T16:38:15.000700+0000","last_unstale":"2023-07-29T16:39:00.554414+0000","last_undegraded":"2023-07-29T16:39:00.554414+0000","last_fullsized":"2023-07-29T16:39:00.554414+0000","mapping_epoch":19,"log_start":"31'3000","ondisk_log_start":"31'3000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3663,"log_dups_size":0,"ondisk_log_size":3663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:24:28.796109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436666368,"num_objects":6663,"num_object_clones":0,"num_object_copies":13326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6663,"num_write_kb":426432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574201+0000","last_change":"2023-07-29T16:37:53.565159+0000","last_active":"2023-07-29T16:38:56.574201+0000","last_peered":"2023-07-29T16:38:56.574201+0000","last_clean":"2023-07-29T16:38:56.574201+0000","last_became_active":"2023-07-29T16:37:53.564726+0000","last_became_peered":"2023-07-29T16:37:53.564726+0000","last_unstale":"2023-07-29T16:38:56.574201+0000","last_undegraded":"2023-07-29T16:38:56.574201+0000","last_fullsized":"2023-07-29T16:38:56.574201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:14:29.616210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575237+0000","last_change":"2023-07-29T16:37:53.961802+0000","last_active":"2023-07-29T16:38:56.575237+0000","last_peered":"2023-07-29T16:38:56.575237+0000","last_clean":"2023-07-29T16:38:56.575237+0000","last_became_active":"2023-07-29T16:37:53.960652+0000","last_became_peered":"2023-07-29T16:37:53.960652+0000","last_unstale":"2023-07-29T16:38:56.575237+0000","last_undegraded":"2023-07-29T16:38:56.575237+0000","last_fullsized":"2023-07-29T16:38:56.575237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:43:22.468442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"44'6604","reported_seq":6641,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.540576+0000","last_change":"2023-07-29T16:38:53.568515+0000","last_active":"2023-07-29T16:39:00.540576+0000","last_peered":"2023-07-29T16:39:00.540576+0000","last_clean":"2023-07-29T16:38:52.550881+0000","last_became_active":"2023-07-29T16:38:53.568515+0000","last_became_peered":"2023-07-29T16:38:53.568515+0000","last_unstale":"2023-07-29T16:39:00.540576+0000","last_undegraded":"2023-07-29T16:38:53.565269+0000","last_fullsized":"2023-07-29T16:38:53.565179+0000","mapping_epoch":41,"log_start":"30'2600","ondisk_log_start":"30'2600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4004,"log_dups_size":0,"ondisk_log_size":4004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:51:37.750142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432799744,"num_objects":6604,"num_object_clones":0,"num_object_copies":13208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6604,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6604,"num_write_kb":422656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6604}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.576001+0000","last_change":"2023-07-29T16:37:53.568250+0000","last_active":"2023-07-29T16:38:56.576001+0000","last_peered":"2023-07-29T16:38:56.576001+0000","last_clean":"2023-07-29T16:38:56.576001+0000","last_became_active":"2023-07-29T16:37:53.567788+0000","last_became_peered":"2023-07-29T16:37:53.567788+0000","last_unstale":"2023-07-29T16:38:56.576001+0000","last_undegraded":"2023-07-29T16:38:56.576001+0000","last_fullsized":"2023-07-29T16:38:56.576001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:50:05.671067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574972+0000","last_change":"2023-07-29T16:38:53.569593+0000","last_active":"2023-07-29T16:38:56.574972+0000","last_peered":"2023-07-29T16:38:56.574972+0000","last_clean":"2023-07-29T16:38:50.558897+0000","last_became_active":"2023-07-29T16:38:53.569593+0000","last_became_peered":"2023-07-29T16:38:53.569593+0000","last_unstale":"2023-07-29T16:38:56.574972+0000","last_undegraded":"2023-07-29T16:38:56.574972+0000","last_fullsized":"2023-07-29T16:38:53.566027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:51:42.763056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"44'6731","reported_seq":6767,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.539459+0000","last_change":"2023-07-29T16:38:53.569592+0000","last_active":"2023-07-29T16:39:00.539459+0000","last_peered":"2023-07-29T16:39:00.539459+0000","last_clean":"2023-07-29T16:38:52.554541+0000","last_became_active":"2023-07-29T16:38:53.569592+0000","last_became_peered":"2023-07-29T16:38:53.569592+0000","last_unstale":"2023-07-29T16:39:00.539459+0000","last_undegraded":"2023-07-29T16:38:53.565647+0000","last_fullsized":"2023-07-29T16:38:53.565543+0000","mapping_epoch":41,"log_start":"30'2700","ondisk_log_start":"30'2700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4031,"log_dups_size":0,"ondisk_log_size":4031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:09:36.791246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441122816,"num_objects":6731,"num_object_clones":0,"num_object_copies":13462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6731,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6731,"num_write_kb":430784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6731}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571455+0000","last_change":"2023-07-29T16:37:53.568132+0000","last_active":"2023-07-29T16:38:56.571455+0000","last_peered":"2023-07-29T16:38:56.571455+0000","last_clean":"2023-07-29T16:38:56.571455+0000","last_became_active":"2023-07-29T16:37:53.566733+0000","last_became_peered":"2023-07-29T16:37:53.566733+0000","last_unstale":"2023-07-29T16:38:56.571455+0000","last_undegraded":"2023-07-29T16:38:56.571455+0000","last_fullsized":"2023-07-29T16:38:56.571455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:06:06.791573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574722+0000","last_change":"2023-07-29T16:38:53.574085+0000","last_active":"2023-07-29T16:38:56.574722+0000","last_peered":"2023-07-29T16:38:56.574722+0000","last_clean":"2023-07-29T16:38:50.560774+0000","last_became_active":"2023-07-29T16:38:53.574085+0000","last_became_peered":"2023-07-29T16:38:53.574085+0000","last_unstale":"2023-07-29T16:38:56.574722+0000","last_undegraded":"2023-07-29T16:38:56.574722+0000","last_fullsized":"2023-07-29T16:38:53.564665+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:28:38.402475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"44'6517","reported_seq":6554,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.541975+0000","last_change":"2023-07-29T16:38:53.570714+0000","last_active":"2023-07-29T16:39:00.541975+0000","last_peered":"2023-07-29T16:39:00.541975+0000","last_clean":"2023-07-29T16:38:52.552730+0000","last_became_active":"2023-07-29T16:38:53.570714+0000","last_became_peered":"2023-07-29T16:38:53.570714+0000","last_unstale":"2023-07-29T16:39:00.541975+0000","last_undegraded":"2023-07-29T16:38:53.565388+0000","last_fullsized":"2023-07-29T16:38:53.565312+0000","mapping_epoch":41,"log_start":"30'2500","ondisk_log_start":"30'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4017,"log_dups_size":0,"ondisk_log_size":4017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:03:25.590225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427098112,"num_objects":6517,"num_object_clones":0,"num_object_copies":13034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6517,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6517,"num_write_kb":417088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6517}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571812+0000","last_change":"2023-07-29T16:38:53.567100+0000","last_active":"2023-07-29T16:38:56.571812+0000","last_peered":"2023-07-29T16:38:56.571812+0000","last_clean":"2023-07-29T16:38:50.560158+0000","last_became_active":"2023-07-29T16:38:53.567100+0000","last_became_peered":"2023-07-29T16:38:53.567100+0000","last_unstale":"2023-07-29T16:38:56.571812+0000","last_undegraded":"2023-07-29T16:38:56.571812+0000","last_fullsized":"2023-07-29T16:38:53.563434+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:45:45.048380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572135+0000","last_change":"2023-07-29T16:38:53.567221+0000","last_active":"2023-07-29T16:38:56.572135+0000","last_peered":"2023-07-29T16:38:56.572135+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.567221+0000","last_became_peered":"2023-07-29T16:38:53.567221+0000","last_unstale":"2023-07-29T16:38:56.572135+0000","last_undegraded":"2023-07-29T16:38:56.572135+0000","last_fullsized":"2023-07-29T16:38:53.563772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:37:15.844027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'6659","reported_seq":6691,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-29T16:39:00.546915+0000","last_change":"2023-07-29T16:38:15.000783+0000","last_active":"2023-07-29T16:39:00.546915+0000","last_peered":"2023-07-29T16:39:00.546915+0000","last_clean":"2023-07-29T16:39:00.546915+0000","last_became_active":"2023-07-29T16:38:15.000526+0000","last_became_peered":"2023-07-29T16:38:15.000526+0000","last_unstale":"2023-07-29T16:39:00.546915+0000","last_undegraded":"2023-07-29T16:39:00.546915+0000","last_fullsized":"2023-07-29T16:39:00.546915+0000","mapping_epoch":19,"log_start":"30'2600","ondisk_log_start":"30'2600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:38:37.626808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436404224,"num_objects":6659,"num_object_clones":0,"num_object_copies":13318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6659,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6659,"num_write_kb":426176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":18,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.571888+0000","last_change":"2023-07-29T16:38:53.571906+0000","last_active":"2023-07-29T16:38:56.571888+0000","last_peered":"2023-07-29T16:38:56.571888+0000","last_clean":"2023-07-29T16:37:53.944646+0000","last_became_active":"2023-07-29T16:38:53.571906+0000","last_became_peered":"2023-07-29T16:38:53.571906+0000","last_unstale":"2023-07-29T16:38:56.571888+0000","last_undegraded":"2023-07-29T16:38:53.564725+0000","last_fullsized":"2023-07-29T16:38:53.564630+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:36:23.914023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572452+0000","last_change":"2023-07-29T16:38:53.575579+0000","last_active":"2023-07-29T16:38:56.572452+0000","last_peered":"2023-07-29T16:38:56.572452+0000","last_clean":"2023-07-29T16:38:50.560244+0000","last_became_active":"2023-07-29T16:38:53.575579+0000","last_became_peered":"2023-07-29T16:38:53.575579+0000","last_unstale":"2023-07-29T16:38:56.572452+0000","last_undegraded":"2023-07-29T16:38:56.572452+0000","last_fullsized":"2023-07-29T16:38:53.563812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T04:03:09.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"44'6720","reported_seq":6757,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.547114+0000","last_change":"2023-07-29T16:38:53.569720+0000","last_active":"2023-07-29T16:39:00.547114+0000","last_peered":"2023-07-29T16:39:00.547114+0000","last_clean":"2023-07-29T16:38:52.549265+0000","last_became_active":"2023-07-29T16:38:53.569720+0000","last_became_peered":"2023-07-29T16:38:53.569720+0000","last_unstale":"2023-07-29T16:39:00.547114+0000","last_undegraded":"2023-07-29T16:38:53.563461+0000","last_fullsized":"2023-07-29T16:38:53.563368+0000","mapping_epoch":41,"log_start":"30'3000","ondisk_log_start":"30'3000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:51:37.750142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440401920,"num_objects":6720,"num_object_clones":0,"num_object_copies":13440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6720,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6720,"num_write_kb":430080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6720}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.573908+0000","last_change":"2023-07-29T16:38:53.573700+0000","last_active":"2023-07-29T16:38:56.573908+0000","last_peered":"2023-07-29T16:38:56.573908+0000","last_clean":"2023-07-29T16:38:50.560810+0000","last_became_active":"2023-07-29T16:38:53.573700+0000","last_became_peered":"2023-07-29T16:38:53.573700+0000","last_unstale":"2023-07-29T16:38:56.573908+0000","last_undegraded":"2023-07-29T16:38:56.573908+0000","last_fullsized":"2023-07-29T16:38:53.563332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:51:34.566219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571859+0000","last_change":"2023-07-29T16:37:53.962824+0000","last_active":"2023-07-29T16:38:56.571859+0000","last_peered":"2023-07-29T16:38:56.571859+0000","last_clean":"2023-07-29T16:38:56.571859+0000","last_became_active":"2023-07-29T16:37:53.961969+0000","last_became_peered":"2023-07-29T16:37:53.961969+0000","last_unstale":"2023-07-29T16:38:56.571859+0000","last_undegraded":"2023-07-29T16:38:56.571859+0000","last_fullsized":"2023-07-29T16:38:56.571859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:39:53.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"44'6563","reported_seq":6594,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-29T16:39:00.543828+0000","last_change":"2023-07-29T16:38:15.000922+0000","last_active":"2023-07-29T16:39:00.543828+0000","last_peered":"2023-07-29T16:39:00.543828+0000","last_clean":"2023-07-29T16:39:00.543828+0000","last_became_active":"2023-07-29T16:38:15.000713+0000","last_became_peered":"2023-07-29T16:38:15.000713+0000","last_unstale":"2023-07-29T16:39:00.543828+0000","last_undegraded":"2023-07-29T16:39:00.543828+0000","last_fullsized":"2023-07-29T16:39:00.543828+0000","mapping_epoch":19,"log_start":"30'2900","ondisk_log_start":"30'2900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3663,"log_dups_size":0,"ondisk_log_size":3663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:47:48.372279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430112768,"num_objects":6563,"num_object_clones":0,"num_object_copies":13126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6563,"num_write_kb":420032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574704+0000","last_change":"2023-07-29T16:37:53.568230+0000","last_active":"2023-07-29T16:38:56.574704+0000","last_peered":"2023-07-29T16:38:56.574704+0000","last_clean":"2023-07-29T16:38:56.574704+0000","last_became_active":"2023-07-29T16:37:53.567793+0000","last_became_peered":"2023-07-29T16:37:53.567793+0000","last_unstale":"2023-07-29T16:38:56.574704+0000","last_undegraded":"2023-07-29T16:38:56.574704+0000","last_fullsized":"2023-07-29T16:38:56.574704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:27:58.144361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.572360+0000","last_change":"2023-07-29T16:37:53.962132+0000","last_active":"2023-07-29T16:38:56.572360+0000","last_peered":"2023-07-29T16:38:56.572360+0000","last_clean":"2023-07-29T16:38:56.572360+0000","last_became_active":"2023-07-29T16:37:53.961580+0000","last_became_peered":"2023-07-29T16:37:53.961580+0000","last_unstale":"2023-07-29T16:38:56.572360+0000","last_undegraded":"2023-07-29T16:38:56.572360+0000","last_fullsized":"2023-07-29T16:38:56.572360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:37:06.053165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'6582","reported_seq":6620,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.539430+0000","last_change":"2023-07-29T16:38:53.569653+0000","last_active":"2023-07-29T16:39:00.539430+0000","last_peered":"2023-07-29T16:39:00.539430+0000","last_clean":"2023-07-29T16:38:52.545722+0000","last_became_active":"2023-07-29T16:38:53.569653+0000","last_became_peered":"2023-07-29T16:38:53.569653+0000","last_unstale":"2023-07-29T16:39:00.539430+0000","last_undegraded":"2023-07-29T16:38:53.566349+0000","last_fullsized":"2023-07-29T16:38:53.566268+0000","mapping_epoch":41,"log_start":"30'2500","ondisk_log_start":"30'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4082,"log_dups_size":0,"ondisk_log_size":4082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:23:47.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431357952,"num_objects":6582,"num_object_clones":0,"num_object_copies":13164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6582,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6582,"num_write_kb":421248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6582}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575002+0000","last_change":"2023-07-29T16:38:53.572987+0000","last_active":"2023-07-29T16:38:56.575002+0000","last_peered":"2023-07-29T16:38:56.575002+0000","last_clean":"2023-07-29T16:38:50.560297+0000","last_became_active":"2023-07-29T16:38:53.572987+0000","last_became_peered":"2023-07-29T16:38:53.572987+0000","last_unstale":"2023-07-29T16:38:56.575002+0000","last_undegraded":"2023-07-29T16:38:56.575002+0000","last_fullsized":"2023-07-29T16:38:53.567218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:05:33.549361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575297+0000","last_change":"2023-07-29T16:38:53.571971+0000","last_active":"2023-07-29T16:38:56.575297+0000","last_peered":"2023-07-29T16:38:56.575297+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.571971+0000","last_became_peered":"2023-07-29T16:38:53.571971+0000","last_unstale":"2023-07-29T16:38:56.575297+0000","last_undegraded":"2023-07-29T16:38:56.575297+0000","last_fullsized":"2023-07-29T16:38:53.565935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:19:22.791678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"44'6641","reported_seq":6677,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.553979+0000","last_change":"2023-07-29T16:38:53.572332+0000","last_active":"2023-07-29T16:39:00.553979+0000","last_peered":"2023-07-29T16:39:00.553979+0000","last_clean":"2023-07-29T16:38:52.538839+0000","last_became_active":"2023-07-29T16:38:53.572332+0000","last_became_peered":"2023-07-29T16:38:53.572332+0000","last_unstale":"2023-07-29T16:39:00.553979+0000","last_undegraded":"2023-07-29T16:38:53.565645+0000","last_fullsized":"2023-07-29T16:38:53.565559+0000","mapping_epoch":41,"log_start":"30'2900","ondisk_log_start":"30'2900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3741,"log_dups_size":0,"ondisk_log_size":3741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:40:02.153400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435224576,"num_objects":6641,"num_object_clones":0,"num_object_copies":13282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6641,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6641,"num_write_kb":425024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6641}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575557+0000","last_change":"2023-07-29T16:38:53.569333+0000","last_active":"2023-07-29T16:38:56.575557+0000","last_peered":"2023-07-29T16:38:56.575557+0000","last_clean":"2023-07-29T16:37:47.525691+0000","last_became_active":"2023-07-29T16:38:53.569333+0000","last_became_peered":"2023-07-29T16:38:53.569333+0000","last_unstale":"2023-07-29T16:38:56.575557+0000","last_undegraded":"2023-07-29T16:38:56.575557+0000","last_fullsized":"2023-07-29T16:38:53.565662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:37:09.821517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571621+0000","last_change":"2023-07-29T16:38:53.572317+0000","last_active":"2023-07-29T16:38:56.571621+0000","last_peered":"2023-07-29T16:38:56.571621+0000","last_clean":"2023-07-29T16:38:50.560640+0000","last_became_active":"2023-07-29T16:38:53.572317+0000","last_became_peered":"2023-07-29T16:38:53.572317+0000","last_unstale":"2023-07-29T16:38:56.571621+0000","last_undegraded":"2023-07-29T16:38:56.571621+0000","last_fullsized":"2023-07-29T16:38:53.565372+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:34:07.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575254+0000","last_change":"2023-07-29T16:37:53.955576+0000","last_active":"2023-07-29T16:38:56.575254+0000","last_peered":"2023-07-29T16:38:56.575254+0000","last_clean":"2023-07-29T16:38:56.575254+0000","last_became_active":"2023-07-29T16:37:53.954906+0000","last_became_peered":"2023-07-29T16:37:53.954906+0000","last_unstale":"2023-07-29T16:38:56.575254+0000","last_undegraded":"2023-07-29T16:38:56.575254+0000","last_fullsized":"2023-07-29T16:38:56.575254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:17:10.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"44'6605","reported_seq":6640,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.546418+0000","last_change":"2023-07-29T16:38:53.567258+0000","last_active":"2023-07-29T16:39:00.546418+0000","last_peered":"2023-07-29T16:39:00.546418+0000","last_clean":"2023-07-29T16:38:52.549807+0000","last_became_active":"2023-07-29T16:38:53.567258+0000","last_became_peered":"2023-07-29T16:38:53.567258+0000","last_unstale":"2023-07-29T16:39:00.546418+0000","last_undegraded":"2023-07-29T16:38:53.563892+0000","last_fullsized":"2023-07-29T16:38:53.563769+0000","mapping_epoch":41,"log_start":"30'2900","ondisk_log_start":"30'2900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:22:17.699792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432865280,"num_objects":6605,"num_object_clones":0,"num_object_copies":13210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6605,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6605,"num_write_kb":422720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6605}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574607+0000","last_change":"2023-07-29T16:38:53.574073+0000","last_active":"2023-07-29T16:38:56.574607+0000","last_peered":"2023-07-29T16:38:56.574607+0000","last_clean":"2023-07-29T16:38:50.560479+0000","last_became_active":"2023-07-29T16:38:53.574073+0000","last_became_peered":"2023-07-29T16:38:53.574073+0000","last_unstale":"2023-07-29T16:38:56.574607+0000","last_undegraded":"2023-07-29T16:38:56.574607+0000","last_fullsized":"2023-07-29T16:38:53.564361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:20:01.666567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572762+0000","last_change":"2023-07-29T16:38:53.567244+0000","last_active":"2023-07-29T16:38:56.572762+0000","last_peered":"2023-07-29T16:38:56.572762+0000","last_clean":"2023-07-29T16:38:50.560457+0000","last_became_active":"2023-07-29T16:38:53.567244+0000","last_became_peered":"2023-07-29T16:38:53.567244+0000","last_unstale":"2023-07-29T16:38:56.572762+0000","last_undegraded":"2023-07-29T16:38:56.572762+0000","last_fullsized":"2023-07-29T16:38:53.564097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:52:06.726227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575761+0000","last_change":"2023-07-29T16:38:53.569853+0000","last_active":"2023-07-29T16:38:56.575761+0000","last_peered":"2023-07-29T16:38:56.575761+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.569853+0000","last_became_peered":"2023-07-29T16:38:53.569853+0000","last_unstale":"2023-07-29T16:38:56.575761+0000","last_undegraded":"2023-07-29T16:38:56.575761+0000","last_fullsized":"2023-07-29T16:38:53.566527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:46:50.772370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'6555","reported_seq":6590,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.550936+0000","last_change":"2023-07-29T16:38:53.577142+0000","last_active":"2023-07-29T16:39:00.550936+0000","last_peered":"2023-07-29T16:39:00.550936+0000","last_clean":"2023-07-29T16:38:52.553801+0000","last_became_active":"2023-07-29T16:38:53.577142+0000","last_became_peered":"2023-07-29T16:38:53.577142+0000","last_unstale":"2023-07-29T16:39:00.550936+0000","last_undegraded":"2023-07-29T16:38:53.564257+0000","last_fullsized":"2023-07-29T16:38:53.563961+0000","mapping_epoch":41,"log_start":"30'2800","ondisk_log_start":"30'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:43:30.943167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429588480,"num_objects":6555,"num_object_clones":0,"num_object_copies":13110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6555,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6555,"num_write_kb":419520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6555}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574817+0000","last_change":"2023-07-29T16:38:53.568839+0000","last_active":"2023-07-29T16:38:56.574817+0000","last_peered":"2023-07-29T16:38:56.574817+0000","last_clean":"2023-07-29T16:37:47.525691+0000","last_became_active":"2023-07-29T16:38:53.568839+0000","last_became_peered":"2023-07-29T16:38:53.568839+0000","last_unstale":"2023-07-29T16:38:56.574817+0000","last_undegraded":"2023-07-29T16:38:56.574817+0000","last_fullsized":"2023-07-29T16:38:53.565451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:10:26.363253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":37,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574899+0000","last_change":"2023-07-29T16:37:53.568687+0000","last_active":"2023-07-29T16:38:56.574899+0000","last_peered":"2023-07-29T16:38:56.574899+0000","last_clean":"2023-07-29T16:38:56.574899+0000","last_became_active":"2023-07-29T16:37:53.568350+0000","last_became_peered":"2023-07-29T16:37:53.568350+0000","last_unstale":"2023-07-29T16:38:56.574899+0000","last_undegraded":"2023-07-29T16:38:56.574899+0000","last_fullsized":"2023-07-29T16:38:56.574899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:02:21.232676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575561+0000","last_change":"2023-07-29T16:38:53.567591+0000","last_active":"2023-07-29T16:38:56.575561+0000","last_peered":"2023-07-29T16:38:56.575561+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.567591+0000","last_became_peered":"2023-07-29T16:38:53.567591+0000","last_unstale":"2023-07-29T16:38:56.575561+0000","last_undegraded":"2023-07-29T16:38:56.575561+0000","last_fullsized":"2023-07-29T16:38:53.565716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:33:07.894146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"44'6780","reported_seq":6817,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.544349+0000","last_change":"2023-07-29T16:38:53.570042+0000","last_active":"2023-07-29T16:39:00.544349+0000","last_peered":"2023-07-29T16:39:00.544349+0000","last_clean":"2023-07-29T16:38:52.540658+0000","last_became_active":"2023-07-29T16:38:53.570042+0000","last_became_peered":"2023-07-29T16:38:53.570042+0000","last_unstale":"2023-07-29T16:39:00.544349+0000","last_undegraded":"2023-07-29T16:38:53.565909+0000","last_fullsized":"2023-07-29T16:38:53.565825+0000","mapping_epoch":41,"log_start":"30'2700","ondisk_log_start":"30'2700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:54:52.245674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444334080,"num_objects":6780,"num_object_clones":0,"num_object_copies":13560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6780,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6780,"num_write_kb":433920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6780}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572251+0000","last_change":"2023-07-29T16:38:53.572033+0000","last_active":"2023-07-29T16:38:56.572251+0000","last_peered":"2023-07-29T16:38:56.572251+0000","last_clean":"2023-07-29T16:38:50.560617+0000","last_became_active":"2023-07-29T16:38:53.572033+0000","last_became_peered":"2023-07-29T16:38:53.572033+0000","last_unstale":"2023-07-29T16:38:56.572251+0000","last_undegraded":"2023-07-29T16:38:56.572251+0000","last_fullsized":"2023-07-29T16:38:53.565227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:09:10.332768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":239,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571361+0000","last_change":"2023-07-29T16:37:42.547849+0000","last_active":"2023-07-29T16:38:56.571361+0000","last_peered":"2023-07-29T16:38:56.571361+0000","last_clean":"2023-07-29T16:38:56.571361+0000","last_became_active":"2023-07-29T16:37:42.546899+0000","last_became_peered":"2023-07-29T16:37:42.546899+0000","last_unstale":"2023-07-29T16:38:56.571361+0000","last_undegraded":"2023-07-29T16:38:56.571361+0000","last_fullsized":"2023-07-29T16:38:56.571361+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:41.509932+0000","last_clean_scrub_stamp":"2023-07-29T16:37:41.509932+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:57:56.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574808+0000","last_change":"2023-07-29T16:38:53.567762+0000","last_active":"2023-07-29T16:38:56.574808+0000","last_peered":"2023-07-29T16:38:56.574808+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.567762+0000","last_became_peered":"2023-07-29T16:38:53.567762+0000","last_unstale":"2023-07-29T16:38:56.574808+0000","last_undegraded":"2023-07-29T16:38:56.574808+0000","last_fullsized":"2023-07-29T16:38:53.565412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:08:52.006118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571711+0000","last_change":"2023-07-29T16:37:53.964243+0000","last_active":"2023-07-29T16:38:56.571711+0000","last_peered":"2023-07-29T16:38:56.571711+0000","last_clean":"2023-07-29T16:38:56.571711+0000","last_became_active":"2023-07-29T16:37:53.963208+0000","last_became_peered":"2023-07-29T16:37:53.963208+0000","last_unstale":"2023-07-29T16:38:56.571711+0000","last_undegraded":"2023-07-29T16:38:56.571711+0000","last_fullsized":"2023-07-29T16:38:56.571711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"44'6631","reported_seq":6668,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.552542+0000","last_change":"2023-07-29T16:38:53.567213+0000","last_active":"2023-07-29T16:39:00.552542+0000","last_peered":"2023-07-29T16:39:00.552542+0000","last_clean":"2023-07-29T16:38:52.556416+0000","last_became_active":"2023-07-29T16:38:53.567213+0000","last_became_peered":"2023-07-29T16:38:53.567213+0000","last_unstale":"2023-07-29T16:39:00.552542+0000","last_undegraded":"2023-07-29T16:38:53.564644+0000","last_fullsized":"2023-07-29T16:38:53.564461+0000","mapping_epoch":41,"log_start":"30'2922","ondisk_log_start":"30'2922","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:38:21.741995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434569216,"num_objects":6631,"num_object_clones":0,"num_object_copies":13262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6631,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6631,"num_write_kb":424384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6631}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.571040+0000","last_change":"2023-07-29T16:37:48.538484+0000","last_active":"2023-07-29T16:38:56.571040+0000","last_peered":"2023-07-29T16:38:56.571040+0000","last_clean":"2023-07-29T16:38:56.571040+0000","last_became_active":"2023-07-29T16:37:48.538173+0000","last_became_peered":"2023-07-29T16:37:48.538173+0000","last_unstale":"2023-07-29T16:38:56.571040+0000","last_undegraded":"2023-07-29T16:38:56.571040+0000","last_fullsized":"2023-07-29T16:38:56.571040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:22:23.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571561+0000","last_change":"2023-07-29T16:38:53.570634+0000","last_active":"2023-07-29T16:38:56.571561+0000","last_peered":"2023-07-29T16:38:56.571561+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.570634+0000","last_became_peered":"2023-07-29T16:38:53.570634+0000","last_unstale":"2023-07-29T16:38:56.571561+0000","last_undegraded":"2023-07-29T16:38:56.571561+0000","last_fullsized":"2023-07-29T16:38:53.563765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T22:38:39.321554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576194+0000","last_change":"2023-07-29T16:38:53.570990+0000","last_active":"2023-07-29T16:38:56.576194+0000","last_peered":"2023-07-29T16:38:56.576194+0000","last_clean":"2023-07-29T16:38:50.559118+0000","last_became_active":"2023-07-29T16:38:53.570990+0000","last_became_peered":"2023-07-29T16:38:53.570990+0000","last_unstale":"2023-07-29T16:38:56.576194+0000","last_undegraded":"2023-07-29T16:38:56.576194+0000","last_fullsized":"2023-07-29T16:38:53.566535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:44:19.394248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"44'6652","reported_seq":6688,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.551222+0000","last_change":"2023-07-29T16:38:53.566887+0000","last_active":"2023-07-29T16:39:00.551222+0000","last_peered":"2023-07-29T16:39:00.551222+0000","last_clean":"2023-07-29T16:38:52.557424+0000","last_became_active":"2023-07-29T16:38:53.566887+0000","last_became_peered":"2023-07-29T16:38:53.566887+0000","last_unstale":"2023-07-29T16:39:00.551222+0000","last_undegraded":"2023-07-29T16:38:53.563045+0000","last_fullsized":"2023-07-29T16:38:53.562940+0000","mapping_epoch":41,"log_start":"30'2900","ondisk_log_start":"30'2900","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:54:15.923156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435945472,"num_objects":6652,"num_object_clones":0,"num_object_copies":13304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6652,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6652,"num_write_kb":425728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6652}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575706+0000","last_change":"2023-07-29T16:38:53.572115+0000","last_active":"2023-07-29T16:38:56.575706+0000","last_peered":"2023-07-29T16:38:56.575706+0000","last_clean":"2023-07-29T16:38:50.559483+0000","last_became_active":"2023-07-29T16:38:53.572115+0000","last_became_peered":"2023-07-29T16:38:53.572115+0000","last_unstale":"2023-07-29T16:38:56.575706+0000","last_undegraded":"2023-07-29T16:38:56.575706+0000","last_fullsized":"2023-07-29T16:38:53.568493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:04:56.963045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575996+0000","last_change":"2023-07-29T16:38:53.575878+0000","last_active":"2023-07-29T16:38:56.575996+0000","last_peered":"2023-07-29T16:38:56.575996+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.575878+0000","last_became_peered":"2023-07-29T16:38:53.575878+0000","last_unstale":"2023-07-29T16:38:56.575996+0000","last_undegraded":"2023-07-29T16:38:56.575996+0000","last_fullsized":"2023-07-29T16:38:53.566796+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:55:25.552474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575100+0000","last_change":"2023-07-29T16:37:53.956973+0000","last_active":"2023-07-29T16:38:56.575100+0000","last_peered":"2023-07-29T16:38:56.575100+0000","last_clean":"2023-07-29T16:38:56.575100+0000","last_became_active":"2023-07-29T16:37:53.955690+0000","last_became_peered":"2023-07-29T16:37:53.955690+0000","last_unstale":"2023-07-29T16:38:56.575100+0000","last_undegraded":"2023-07-29T16:38:56.575100+0000","last_fullsized":"2023-07-29T16:38:56.575100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T23:15:46.307641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"44'6724","reported_seq":6760,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.554622+0000","last_change":"2023-07-29T16:38:53.567063+0000","last_active":"2023-07-29T16:39:00.554622+0000","last_peered":"2023-07-29T16:39:00.554622+0000","last_clean":"2023-07-29T16:38:52.545714+0000","last_became_active":"2023-07-29T16:38:53.567063+0000","last_became_peered":"2023-07-29T16:38:53.567063+0000","last_unstale":"2023-07-29T16:39:00.554622+0000","last_undegraded":"2023-07-29T16:38:53.563180+0000","last_fullsized":"2023-07-29T16:38:53.563062+0000","mapping_epoch":41,"log_start":"31'3000","ondisk_log_start":"31'3000","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:37:23.981478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440664064,"num_objects":6724,"num_object_clones":0,"num_object_copies":13448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6724,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6724,"num_write_kb":430336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6724}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":18,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.575899+0000","last_change":"2023-07-29T16:38:53.572196+0000","last_active":"2023-07-29T16:38:56.575899+0000","last_peered":"2023-07-29T16:38:56.575899+0000","last_clean":"2023-07-29T16:37:53.945986+0000","last_became_active":"2023-07-29T16:38:53.572196+0000","last_became_peered":"2023-07-29T16:38:53.572196+0000","last_unstale":"2023-07-29T16:38:56.575899+0000","last_undegraded":"2023-07-29T16:38:53.566108+0000","last_fullsized":"2023-07-29T16:38:53.566005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:43:51.857291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.576087+0000","last_change":"2023-07-29T16:38:53.570810+0000","last_active":"2023-07-29T16:38:56.576087+0000","last_peered":"2023-07-29T16:38:56.576087+0000","last_clean":"2023-07-29T16:37:47.525691+0000","last_became_active":"2023-07-29T16:38:53.570810+0000","last_became_peered":"2023-07-29T16:38:53.570810+0000","last_unstale":"2023-07-29T16:38:56.576087+0000","last_undegraded":"2023-07-29T16:38:56.576087+0000","last_fullsized":"2023-07-29T16:38:53.566366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:52:56.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.570938+0000","last_change":"2023-07-29T16:38:53.566874+0000","last_active":"2023-07-29T16:38:56.570938+0000","last_peered":"2023-07-29T16:38:56.570938+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.566874+0000","last_became_peered":"2023-07-29T16:38:53.566874+0000","last_unstale":"2023-07-29T16:38:56.570938+0000","last_undegraded":"2023-07-29T16:38:56.570938+0000","last_fullsized":"2023-07-29T16:38:53.562856+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:39:33.048978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"44'6745","reported_seq":6783,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:39:00.548470+0000","last_change":"2023-07-29T16:38:53.567570+0000","last_active":"2023-07-29T16:39:00.548470+0000","last_peered":"2023-07-29T16:39:00.548470+0000","last_clean":"2023-07-29T16:38:52.556847+0000","last_became_active":"2023-07-29T16:38:53.567570+0000","last_became_peered":"2023-07-29T16:38:53.567570+0000","last_unstale":"2023-07-29T16:39:00.548470+0000","last_undegraded":"2023-07-29T16:38:53.565227+0000","last_fullsized":"2023-07-29T16:38:53.565165+0000","mapping_epoch":41,"log_start":"30'2700","ondisk_log_start":"30'2700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:38:13.984169+0000","last_clean_scrub_stamp":"2023-07-29T16:38:13.984169+0000","objects_scrubbed":0,"log_size":4045,"log_dups_size":0,"ondisk_log_size":4045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:47:26.558051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442040320,"num_objects":6745,"num_object_clones":0,"num_object_copies":13490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6745,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6745,"num_write_kb":431680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":6745}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574194+0000","last_change":"2023-07-29T16:37:48.538500+0000","last_active":"2023-07-29T16:38:56.574194+0000","last_peered":"2023-07-29T16:38:56.574194+0000","last_clean":"2023-07-29T16:38:56.574194+0000","last_became_active":"2023-07-29T16:37:48.538249+0000","last_became_peered":"2023-07-29T16:37:48.538249+0000","last_unstale":"2023-07-29T16:38:56.574194+0000","last_undegraded":"2023-07-29T16:38:56.574194+0000","last_fullsized":"2023-07-29T16:38:56.574194+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:47.525691+0000","last_clean_scrub_stamp":"2023-07-29T16:37:47.525691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:13:13.418144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":20,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.572132+0000","last_change":"2023-07-29T16:38:53.577571+0000","last_active":"2023-07-29T16:38:56.572132+0000","last_peered":"2023-07-29T16:38:56.572132+0000","last_clean":"2023-07-29T16:37:55.749476+0000","last_became_active":"2023-07-29T16:38:53.577571+0000","last_became_peered":"2023-07-29T16:38:53.577571+0000","last_unstale":"2023-07-29T16:38:56.572132+0000","last_undegraded":"2023-07-29T16:38:53.565574+0000","last_fullsized":"2023-07-29T16:38:53.565463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:28:02.675343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.574938+0000","last_change":"2023-07-29T16:37:53.955794+0000","last_active":"2023-07-29T16:38:56.574938+0000","last_peered":"2023-07-29T16:38:56.574938+0000","last_clean":"2023-07-29T16:38:56.574938+0000","last_became_active":"2023-07-29T16:37:53.954882+0000","last_became_peered":"2023-07-29T16:37:53.954882+0000","last_unstale":"2023-07-29T16:38:56.574938+0000","last_undegraded":"2023-07-29T16:38:56.574938+0000","last_fullsized":"2023-07-29T16:38:56.574938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T02:06:58.786830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575241+0000","last_change":"2023-07-29T16:37:53.567716+0000","last_active":"2023-07-29T16:38:56.575241+0000","last_peered":"2023-07-29T16:38:56.575241+0000","last_clean":"2023-07-29T16:38:56.575241+0000","last_became_active":"2023-07-29T16:37:53.567145+0000","last_became_peered":"2023-07-29T16:37:53.567145+0000","last_unstale":"2023-07-29T16:38:56.575241+0000","last_undegraded":"2023-07-29T16:38:56.575241+0000","last_fullsized":"2023-07-29T16:38:56.575241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:34:45.812120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575872+0000","last_change":"2023-07-29T16:38:53.574565+0000","last_active":"2023-07-29T16:38:56.575872+0000","last_peered":"2023-07-29T16:38:56.575872+0000","last_clean":"2023-07-29T16:38:50.560910+0000","last_became_active":"2023-07-29T16:38:53.574565+0000","last_became_peered":"2023-07-29T16:38:53.574565+0000","last_unstale":"2023-07-29T16:38:56.575872+0000","last_undegraded":"2023-07-29T16:38:56.575872+0000","last_fullsized":"2023-07-29T16:38:53.566851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:15:29.531815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":44,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.572214+0000","last_change":"2023-07-29T16:38:53.570003+0000","last_active":"2023-07-29T16:38:56.572214+0000","last_peered":"2023-07-29T16:38:56.572214+0000","last_clean":"2023-07-29T16:38:50.560343+0000","last_became_active":"2023-07-29T16:38:53.570003+0000","last_became_peered":"2023-07-29T16:38:53.570003+0000","last_unstale":"2023-07-29T16:38:56.572214+0000","last_undegraded":"2023-07-29T16:38:53.564034+0000","last_fullsized":"2023-07-29T16:38:53.563938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T21:56:27.944738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.572691+0000","last_change":"2023-07-29T16:38:53.575488+0000","last_active":"2023-07-29T16:38:56.572691+0000","last_peered":"2023-07-29T16:38:56.572691+0000","last_clean":"2023-07-29T16:38:50.560788+0000","last_became_active":"2023-07-29T16:38:53.575488+0000","last_became_peered":"2023-07-29T16:38:53.575488+0000","last_unstale":"2023-07-29T16:38:56.572691+0000","last_undegraded":"2023-07-29T16:38:56.572691+0000","last_fullsized":"2023-07-29T16:38:53.566682+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T20:47:01.655421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575868+0000","last_change":"2023-07-29T16:37:53.569388+0000","last_active":"2023-07-29T16:38:56.575868+0000","last_peered":"2023-07-29T16:38:56.575868+0000","last_clean":"2023-07-29T16:38:56.575868+0000","last_became_active":"2023-07-29T16:37:53.568677+0000","last_became_peered":"2023-07-29T16:37:53.568677+0000","last_unstale":"2023-07-29T16:38:56.575868+0000","last_undegraded":"2023-07-29T16:38:56.575868+0000","last_fullsized":"2023-07-29T16:38:56.575868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:37:44.984614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574451+0000","last_change":"2023-07-29T16:38:53.573623+0000","last_active":"2023-07-29T16:38:56.574451+0000","last_peered":"2023-07-29T16:38:56.574451+0000","last_clean":"2023-07-29T16:38:50.560336+0000","last_became_active":"2023-07-29T16:38:53.573623+0000","last_became_peered":"2023-07-29T16:38:53.573623+0000","last_unstale":"2023-07-29T16:38:56.574451+0000","last_undegraded":"2023-07-29T16:38:56.574451+0000","last_fullsized":"2023-07-29T16:38:53.563461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:51:11.115543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575778+0000","last_change":"2023-07-29T16:38:53.567880+0000","last_active":"2023-07-29T16:38:56.575778+0000","last_peered":"2023-07-29T16:38:56.575778+0000","last_clean":"2023-07-29T16:37:52.543061+0000","last_became_active":"2023-07-29T16:38:53.567880+0000","last_became_peered":"2023-07-29T16:38:53.567880+0000","last_unstale":"2023-07-29T16:38:56.575778+0000","last_undegraded":"2023-07-29T16:38:56.575778+0000","last_fullsized":"2023-07-29T16:38:53.565723+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:37:02.540370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.570891+0000","last_change":"2023-07-29T16:38:53.566900+0000","last_active":"2023-07-29T16:38:56.570891+0000","last_peered":"2023-07-29T16:38:56.570891+0000","last_clean":"2023-07-29T16:38:50.559859+0000","last_became_active":"2023-07-29T16:38:53.566900+0000","last_became_peered":"2023-07-29T16:38:53.566900+0000","last_unstale":"2023-07-29T16:38:56.570891+0000","last_undegraded":"2023-07-29T16:38:56.570891+0000","last_fullsized":"2023-07-29T16:38:53.562840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T19:21:22.665751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":43,"state":"active+undersized+degraded","last_fresh":"2023-07-29T16:38:56.576750+0000","last_change":"2023-07-29T16:38:53.577665+0000","last_active":"2023-07-29T16:38:56.576750+0000","last_peered":"2023-07-29T16:38:56.576750+0000","last_clean":"2023-07-29T16:37:53.946219+0000","last_became_active":"2023-07-29T16:38:53.577665+0000","last_became_peered":"2023-07-29T16:38:53.577665+0000","last_unstale":"2023-07-29T16:38:56.576750+0000","last_undegraded":"2023-07-29T16:38:53.566671+0000","last_fullsized":"2023-07-29T16:38:53.566564+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:52.543061+0000","last_clean_scrub_stamp":"2023-07-29T16:37:52.543061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T17:59:52.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571247+0000","last_change":"2023-07-29T16:38:53.571735+0000","last_active":"2023-07-29T16:38:56.571247+0000","last_peered":"2023-07-29T16:38:56.571247+0000","last_clean":"2023-07-29T16:38:50.560028+0000","last_became_active":"2023-07-29T16:38:53.571735+0000","last_became_peered":"2023-07-29T16:38:53.571735+0000","last_unstale":"2023-07-29T16:38:56.571247+0000","last_undegraded":"2023-07-29T16:38:56.571247+0000","last_fullsized":"2023-07-29T16:38:53.563726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:48:44.882000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.571128+0000","last_change":"2023-07-29T16:38:53.567676+0000","last_active":"2023-07-29T16:38:56.571128+0000","last_peered":"2023-07-29T16:38:56.571128+0000","last_clean":"2023-07-29T16:38:50.559940+0000","last_became_active":"2023-07-29T16:38:53.567676+0000","last_became_peered":"2023-07-29T16:38:53.567676+0000","last_unstale":"2023-07-29T16:38:56.571128+0000","last_undegraded":"2023-07-29T16:38:56.571128+0000","last_fullsized":"2023-07-29T16:38:53.563239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T16:51:42.763056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.574842+0000","last_change":"2023-07-29T16:38:53.568848+0000","last_active":"2023-07-29T16:38:56.574842+0000","last_peered":"2023-07-29T16:38:56.574842+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.568848+0000","last_became_peered":"2023-07-29T16:38:53.568848+0000","last_unstale":"2023-07-29T16:38:56.574842+0000","last_undegraded":"2023-07-29T16:38:56.574842+0000","last_fullsized":"2023-07-29T16:38:53.565696+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T00:52:46.433488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575340+0000","last_change":"2023-07-29T16:37:53.955949+0000","last_active":"2023-07-29T16:38:56.575340+0000","last_peered":"2023-07-29T16:38:56.575340+0000","last_clean":"2023-07-29T16:38:56.575340+0000","last_became_active":"2023-07-29T16:37:53.955136+0000","last_became_peered":"2023-07-29T16:37:53.955136+0000","last_unstale":"2023-07-29T16:38:56.575340+0000","last_undegraded":"2023-07-29T16:38:56.575340+0000","last_fullsized":"2023-07-29T16:38:56.575340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T01:39:02.569850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+undersized","last_fresh":"2023-07-29T16:38:56.575333+0000","last_change":"2023-07-29T16:38:53.574895+0000","last_active":"2023-07-29T16:38:56.575333+0000","last_peered":"2023-07-29T16:38:56.575333+0000","last_clean":"2023-07-29T16:37:53.548201+0000","last_became_active":"2023-07-29T16:38:53.574895+0000","last_became_peered":"2023-07-29T16:38:53.574895+0000","last_unstale":"2023-07-29T16:38:56.575333+0000","last_undegraded":"2023-07-29T16:38:56.575333+0000","last_fullsized":"2023-07-29T16:38:53.567491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T18:21:57.263825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":36,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-29T16:38:56.575979+0000","last_change":"2023-07-29T16:37:53.959397+0000","last_active":"2023-07-29T16:38:56.575979+0000","last_peered":"2023-07-29T16:38:56.575979+0000","last_clean":"2023-07-29T16:38:56.575979+0000","last_became_active":"2023-07-29T16:37:53.958647+0000","last_became_peered":"2023-07-29T16:37:53.958647+0000","last_unstale":"2023-07-29T16:38:56.575979+0000","last_undegraded":"2023-07-29T16:38:56.575979+0000","last_fullsized":"2023-07-29T16:38:56.575979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T16:37:53.548201+0000","last_clean_scrub_stamp":"2023-07-29T16:37:53.548201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-31T03:21:53.290194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6971195392,"num_objects":106372,"num_object_clones":0,"num_object_copies":212744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":86487,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106372,"num_write_kb":6807808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":804491264,"data_stored":12871860224,"data_compressed":61657738,"data_compressed_allocated":804491264,"data_compressed_original":12871860224,"omap_allocated":0,"internal_metadata":0},"log_size":61750,"ondisk_log_size":61750,"up":19,"acting":19,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":83,"acting":83,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":43,"acting":43,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":20122,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387608,"kb_used_data":276172,"kb_used_omap":0,"kb_used_meta":111424,"kb_avail":93984232,"statfs":{"total":96636764160,"available":96239853568,"internally_reserved":0,"allocated":282800128,"data_stored":4518205113,"data_compressed":21638126,"data_compressed_allocated":282378240,"data_compressed_original":4518051840,"omap_allocated":0,"internal_metadata":114098176},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 16:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Jul 29 16:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.24399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341832,"kb_used_data":238592,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94030008,"statfs":{"total":96636764160,"available":96286728192,"internally_reserved":0,"allocated":244318208,"data_stored":3900948092,"data_compressed":18693868,"data_compressed_allocated":243798016,"data_compressed_original":3900751872,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 16:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":71.745000000000005},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":71.837000000000003}]},{"osd":2,"last update":"Sat Jul 29 16:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.22500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373272,"kb_used_data":265936,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":93998568,"statfs":{"total":96636764160,"available":96254533632,"internally_reserved":0,"allocated":272318464,"data_stored":4348821732,"data_compressed":20839604,"data_compressed_allocated":271790080,"data_compressed_original":4348624896,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 16:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Jul 29 16:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.23100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":10061,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":245121024,"data_stored":3921936384,"data_compressed":18788387,"data_compressed_allocated":245121024,"data_compressed_original":3921936384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":272064512,"data_stored":4353032192,"data_compressed":20853483,"data_compressed_allocated":272064512,"data_compressed_original":4353032192,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":287305728,"data_stored":4596891648,"data_compressed":22015868,"data_compressed_allocated":287305728,"data_compressed_original":4596891648,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T16:39:03.076 INFO:tasks.thrashosds.thrasher:Setting 4.16 to [1, 0] 2023-07-29T16:39:03.077 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.16', '1', '0'] 2023-07-29T16:39:03.077 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.16 1 0 2023-07-29T16:39:03.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 47 16 112551 112535 149.635 153.188 0.00285695 0.0066803 2023-07-29T16:39:03.079 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:03.077+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:03.183 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.179+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.281 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.279+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.281 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:03.282 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:03.297 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:03.387 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.383+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.481 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.480+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.521 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:03.521 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:03.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:03.582 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:03.580+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:03.586 INFO:teuthology.orchestra.run.smithi070.stderr:set 4.16 pg_upmap mapping to [1,0] 2023-07-29T16:39:03.683 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.681+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.714 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:03.714 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:03.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:03.811 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:03.809+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:03.884 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:03.883+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:03.936 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:03.936 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:03.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:03.994 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:03.992+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 48 16 114941 114925 149.629 149.375 0.00641437 0.0066806 2023-07-29T16:39:04.087 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:04.085+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:04.168 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:04.168 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:04.184 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:04.188 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:04.186+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.289 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:04.287+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:04.363 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:04.364 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:04.378 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:04.421 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:04.420+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:04.490 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:04.488+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.506 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:04.527 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:04.527 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:04.527 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:04.528 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:04.530 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:04.530 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:04.547 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:04.547 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:04.547 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:04.547 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:04.548 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:04.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:04.590 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:04.589+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:39:04.692 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:04.690+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:04.780 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:04.780 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:04.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:04.780 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:04.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.781 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:04.782 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:04.782 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 82.25375726, 2023-07-29T16:39:04.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:04.782 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.783 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:04.783 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:04.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:04.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.784 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:04.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:04.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:04.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:04.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:04.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:04.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:04.797 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.828662660999996, 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:04.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:04.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:04.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:04.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:04.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:04.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.810 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.828402892, 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:04.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:04.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:04.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:04.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:04.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:04.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.823 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.828332021999998, 2023-07-29T16:39:04.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:04.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:04.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:04.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:04.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:04.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.833 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.732474669, 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:04.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:04.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:04.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:04.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.700327295999999, 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:04.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:04.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.578025165, 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:04.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:04.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:04.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.866 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3605532910000004, 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.867 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:04.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:04.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:04.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:04.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:04.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3580328789999996, 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:04.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.879 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:04.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:04.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:04.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.357911133, 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:04.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:04.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:04.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:04.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:04.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3576691679999993, 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:04.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:04.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.907 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3575189139999999, 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:04.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:04.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:04.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3574405180000007, 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.917 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:04.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:04.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:04.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3573960419999995, 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.926 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.356950908, 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3568647600000006, 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3558646169999999, 2023-07-29T16:39:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3555308040000007, 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3508202699999998, 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3505090089999996, 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:04.991 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:04.992 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:04.990+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:04.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:05.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 49 16 117268 117252 149.543 145.438 0.00354748 0.00668472 2023-07-29T16:39:05.093 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:05.091+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:05.166 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:05.166 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:05.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.167 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117461 5.d 5:b6140a8c:::benchmark_data_smithi070_97781_object117460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.152717+0000", 2023-07-29T16:39:05.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011209066, 2023-07-29T16:39:05.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011229721999999999, 2023-07-29T16:39:05.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:05.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117461 2023-07-29T16:39:05.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152717+0000", 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152717+0000", 2023-07-29T16:39:05.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152717+0000", 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152796+0000", 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9762e-05 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152807+0000", 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0489000000000001e-05 2023-07-29T16:39:05.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152813+0000", 2023-07-29T16:39:05.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3579999999999999e-06 2023-07-29T16:39:05.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.155793+0000", 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029799750000000002 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.155908+0000", 2023-07-29T16:39:05.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115285 2023-07-29T16:39:05.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.155996+0000", 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7564000000000004e-05 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.162608+0000", 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066119250000000003 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117462 5.d 5:b62b47bc:::benchmark_data_smithi070_97781_object117461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.152889+0000", 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.011037365, 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011110649, 2023-07-29T16:39:05.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:05.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117462 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152889+0000", 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152889+0000", 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.152888+0000", 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.153033+0000", 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014441200000000001 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.153042+0000", 2023-07-29T16:39:05.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5589999999999994e-06 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.153050+0000", 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.559e-06 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.158608+0000", 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055577539999999998 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.158761+0000", 2023-07-29T16:39:05.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015384 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.158947+0000", 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018501800000000001 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.162828+0000", 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003881986 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117482 5.e 5:7c9c69c9:::benchmark_data_smithi070_97781_object117481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.163017+0000", 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00090966899999999999, 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001029264, 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117482 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163017+0000", 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163017+0000", 2023-07-29T16:39:05.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163016+0000", 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163077+0000", 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1617000000000003e-05 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163092+0000", 2023-07-29T16:39:05.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4431e-05 2023-07-29T16:39:05.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163102+0000", 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.064e-05 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163138+0000", 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5386000000000003e-05 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.163233+0000", 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5192999999999995e-05 2023-07-29T16:39:05.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 3 2023-07-29T16:39:05.198 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:05.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:05.200 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:05.197+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:05.300 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:05.299+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:05.401 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:05.399+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:05.410 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:05.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:05.410 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:05.411 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:05.411 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:05.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:05.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2023-07-29T16:39:05.507 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:05.505+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:05.594 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:39:05.603 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:05.601+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:05.642 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:05.642 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:05.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.588042737, 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:05.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:05.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:05.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:05.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:05.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:05.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.655 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.656 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.656 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:05.657 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.587958907000001, 2023-07-29T16:39:05.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:05.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:05.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.659 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:05.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:05.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:05.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:05.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:05.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:05.670 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.585415942000001, 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.671 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:05.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.570655896, 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.684 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.684 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.684 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:05.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.685 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:05.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:05.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:05.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:05.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:05.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:05.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:05.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:05.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:05.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:05.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:05.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:05.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.699 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.700 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.700 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:05.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.54312985, 2023-07-29T16:39:05.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:05.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.703 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:05.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.703 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:05.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:05.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:05.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:05.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:05.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:05.714 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.542970046000001, 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.716 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:05.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:05.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:05.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:05.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:05.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:05.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:05.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:05.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:05.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:05.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:05.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:05.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:05.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:05.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:05.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:05.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.731 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:05.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.538842894, 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:05.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.733 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:05.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:05.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:05.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:05.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:05.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:05.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:05.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:05.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:05.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:05.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:05.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:05.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:05.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:05.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.533196089, 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:05.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:05.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.488206796, 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.431123889, 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.431049806000001, 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.430851390999999, 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.430470072, 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:05.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:05.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:05.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.814 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.429076949000001, 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:05.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:05.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:05.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:05.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:05.825 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.9538811210000002, 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:05.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:05.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:05.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:05.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:05.835 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3935833610000001, 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:05.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:05.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.013930139, 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.846 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:05.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:05.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.854 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.32537697300000001, 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:05.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:05.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:05.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:05.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.32048249200000001, 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:05.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:05.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.873 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.31881474599999998, 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:05.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:05.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:05.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:05.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:05.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:05.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:05.884 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:05.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:05.886 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:05.883+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:05.986 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:05.984+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.067 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:06.067 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:06.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119681 5.f 5:f7aa2590:::benchmark_data_smithi070_97781_object119680:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.059322+0000", 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0052404799999999996, 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052603040000000004, 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:06.068 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119681 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059322+0000", 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059322+0000", 2023-07-29T16:39:06.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059321+0000", 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059388+0000", 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6532999999999995e-05 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059400+0000", 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2199e-05 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059408+0000", 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1019999999999997e-06 2023-07-29T16:39:06.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059454+0000", 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6134000000000002e-05 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059647+0000", 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000192566 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.059834+0000", 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187147 2023-07-29T16:39:06.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.062780+0000", 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029462939999999999 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119685 5.5 5:a9303a55:::benchmark_data_smithi070_97781_object119684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.060241+0000", 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004321063, 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0044138709999999998, 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.077 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119685 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060241+0000", 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060241+0000", 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060241+0000", 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060266+0000", 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5469e-05 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060272+0000", 2023-07-29T16:39:06.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2040000000000002e-06 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060278+0000", 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1420000000000001e-06 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060630+0000", 2023-07-29T16:39:06.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00035246000000000002 2023-07-29T16:39:06.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060761+0000", 2023-07-29T16:39:06.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013114600000000001 2023-07-29T16:39:06.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119687 5.c 5:3224f508:::benchmark_data_smithi070_97781_object119686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.060554+0000", 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004008869, 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041699249999999997, 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119687 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060554+0000", 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060554+0000", 2023-07-29T16:39:06.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060553+0000", 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060610+0000", 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6999000000000001e-05 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060618+0000", 2023-07-29T16:39:06.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6869999999999994e-06 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060625+0000", 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8050000000000001e-06 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060666+0000", 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1278e-05 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060846+0000", 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000180006 2023-07-29T16:39:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:119683 5.d e48/19 5:bd414f76:::benchmark_data_smithi070_97781_object119682:head v 48'7451, mlcod=48'7446)", 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.060767+0000", 2023-07-29T16:39:06.092 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003795292, 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040302350000000001, 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060767+0000", 2023-07-29T16:39:06.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060767+0000", 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060767+0000", 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060839+0000", 2023-07-29T16:39:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2335000000000005e-05 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060846+0000", 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1849999999999998e-06 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060852+0000", 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7289999999999997e-06 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060883+0000", 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0991000000000002e-05 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.060902+0000", 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9463e-05 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119693 5.f 5:ff5fd766:::benchmark_data_smithi070_97781_object119692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.063052+0000", 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0015106519999999999, 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018122520000000001, 2023-07-29T16:39:06.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.100 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:06.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119693 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063052+0000", 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063052+0000", 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063051+0000", 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063106+0000", 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5390999999999999e-05 2023-07-29T16:39:06.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063115+0000", 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4079999999999998e-06 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063119+0000", 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4909999999999999e-06 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063149+0000", 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9788999999999999e-05 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063254+0000", 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000104798 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.063344+0000", 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0025000000000006e-05 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop(client.4749.0:119689 5.d e48/19 5:b5597bf3:::benchmark_data_smithi070_97781_object119688:head v 48'7452, mlcod=48'7447)", 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.064607+0000", 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9999557, 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00030684100000000003, 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064607+0000", 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064607+0000", 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064606+0000", 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064715+0000", 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010887600000000001 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064727+0000", 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1508999999999999e-05 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064732+0000", 2023-07-29T16:39:06.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8099999999999997e-06 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064778+0000", 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6363999999999999e-05 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064799+0000", 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1463000000000001e-05 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119694 5.2 5:4c09c0ba:::benchmark_data_smithi070_97781_object119693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.064691+0000", 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9998717, 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00026210399999999998, 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.115 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119694 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064691+0000", 2023-07-29T16:39:06.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064691+0000", 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064690+0000", 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064754+0000", 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4206000000000002e-05 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064764+0000", 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0101e-05 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064772+0000", 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9219999999999997e-06 2023-07-29T16:39:06.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064811+0000", 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8396000000000003e-05 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064898+0000", 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7310000000000003e-05 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:119695 5.2 5.9771bb12 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:06.064785+0000", 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9997773, 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00020730600000000001, 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 119695 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064785+0000", 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064785+0000", 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064785+0000", 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064819+0000", 2023-07-29T16:39:06.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4545000000000002e-05 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064827+0000", 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5449999999999998e-06 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:06.064833+0000", 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1040000000000003e-06 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.128 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:06.129 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 8 2023-07-29T16:39:06.129 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:06.130 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 50 15 119723 119708 149.622 153.5 0.00579602 0.00668111 2023-07-29T16:39:06.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:06.131 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.128+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.231 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.229+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.332 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.330+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.345 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:06.345 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:06.345 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:06.345 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:06.345 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:06.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:06.444 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.442+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:06.536 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:06.534+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:06.582 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:06.582 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:06.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:06.582 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:06.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 84.056544184000003, 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:06.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:06.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:06.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:06.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 72.631449584999999, 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:06.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:06.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:06.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 72.631189816000003, 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.606 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:06.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:06.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.616 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 72.631118946000001, 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:06.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.535261593, 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:06.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:06.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:06.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.503114220000001, 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.636 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:06.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:06.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:06.646 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.380812089000001, 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:06.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:06.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:06.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:06.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.163340215, 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.657 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:06.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:06.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:06.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:06.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.666 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160819803000001, 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:06.667 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:06.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:06.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:06.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:06.676 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160698056999999, 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:06.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:06.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:06.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.685 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160456092, 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.686 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:06.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:06.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:06.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160305837999999, 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.696 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:06.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:06.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.704 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160227442, 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:06.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:06.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:06.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.160182966000001, 2023-07-29T16:39:06.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.715 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:06.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:06.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:06.723 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.159737831999999, 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:06.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:06.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.732 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.159651684, 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:06.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:06.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.741 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.158651540999999, 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.742 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:06.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:06.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.750 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.158317728, 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.751 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:06.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.153607193999999, 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:06.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:06.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:06.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 10.153295933000001, 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:06.767 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:06.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:06.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:06.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:06.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:06.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:06.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.777 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:06.777 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:06.777 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:06.778 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:06.776+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:06.778 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:06.779 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:06.779 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:06.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:06.781 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:06.879 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.877+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:06.956 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:06.956 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:06.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:06.980 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:06.978+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.078 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 51 16 122202 122186 149.725 154.875 0.00505272 0.00667641 2023-07-29T16:39:07.081 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.079+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.147 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:07.148 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:07.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:07.209 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:07.206+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:07.282 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.280+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.339 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:07.340 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:07.353 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:07.395 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:07.393+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:07.484 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.482+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.538 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:07.538 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:07.554 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:07.595 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.593+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:39:07.686 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.684+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:07.770 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:07.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:07.786 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:07.784+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:07.887 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:07.885+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:07.988 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:07.986+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:08.005 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:08.005 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:08.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:08.079 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 52 16 124600 124584 149.727 149.875 0.00372502 0.00667632 2023-07-29T16:39:08.089 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.087+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.190 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.188+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.199 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:08.199 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:08.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:08.292 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:08.289+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:08.392 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.390+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.425 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:08.425 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:08.439 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:08.523 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.521+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.594 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:08.592+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:08.599 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-07-29T16:39:08.600 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:39:08.600 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-07-29T16:39:08.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-07-29T16:39:08.601 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:39:08.664 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:08.665 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:08.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:08.722 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.720+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:08.794 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.792+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.862 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:08.862 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:08.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:08.895 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:08.893+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:08.930 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:08.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-07-29T16:39:08.941 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 49, 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "c7d00049-842a-4a32-8de6-3e4b9423aea7", 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2023-07-29T16:37:31.745128+0000", 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2023-07-29T16:39:08.590596+0000", 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2023-07-29T16:38:52.552792+0000", 2023-07-29T16:39:08.942 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2023-07-29T16:37:32.650908+0000", 2023-07-29T16:39:08.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-29T16:39:08.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2023-07-29T16:39:08.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2023-07-29T16:39:08.943 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2023-07-29T16:39:08.944 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2023-07-29T16:39:08.944 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2023-07-29T16:39:08.944 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2023-07-29T16:39:08.945 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2023-07-29T16:39:08.945 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:08.945 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2023-07-29T16:39:08.945 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2023-07-29T16:39:08.946 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-07-29T16:39:08.946 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2023-07-29T16:39:08.946 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2023-07-29T16:39:08.946 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 5, 2023-07-29T16:39:08.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2023-07-29T16:39:08.947 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2023-07-29T16:39:08.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2023-07-29T16:39:08.947 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "reef", 2023-07-29T16:39:08.948 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2023-07-29T16:39:08.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2023-07-29T16:39:08.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:08.948 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2023-07-29T16:39:08.949 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2023-07-29T16:39:08.949 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:41.494530+0000", 2023-07-29T16:39:08.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:08.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:08.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:08.950 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:08.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:08.950 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:08.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:08.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:08.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:08.951 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:08.952 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:08.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:08.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2023-07-29T16:39:08.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2023-07-29T16:39:08.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2023-07-29T16:39:08.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2023-07-29T16:39:08.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2023-07-29T16:39:08.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:08.954 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:08.954 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:08.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:08.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:08.955 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:08.955 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:08.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.956 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2023-07-29T16:39:08.956 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:08.957 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:08.957 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:08.957 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:08.957 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:08.958 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:08.958 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:08.958 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:08.959 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:08.959 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:08.959 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:08.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:08.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:08.960 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:08.960 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:08.961 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:08.961 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:08.961 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:08.962 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:08.962 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:08.962 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:08.962 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:08.963 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:08.963 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:08.963 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:08.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:08.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.964 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:08.964 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:08.965 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:08.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:08.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:08.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:08.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:08.966 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:08.966 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:08.966 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:08.967 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:08.967 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:08.967 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2023-07-29T16:39:08.967 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2023-07-29T16:39:08.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.968 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:08.968 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2023-07-29T16:39:08.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.969 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:08.969 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2023-07-29T16:39:08.969 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2023-07-29T16:39:08.969 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:08.970 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2023-07-29T16:39:08.970 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2023-07-29T16:39:08.970 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:08.970 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:08.971 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:08.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:08.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:08.972 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2023-07-29T16:39:08.972 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2023-07-29T16:39:08.972 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:47.008107+0000", 2023-07-29T16:39:08.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:08.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:08.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:08.973 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:08.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:08.974 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:08.974 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:08.974 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:08.974 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:08.975 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:08.975 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:08.975 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:08.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2023-07-29T16:39:08.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2023-07-29T16:39:08.976 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2023-07-29T16:39:08.977 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2023-07-29T16:39:08.977 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2023-07-29T16:39:08.977 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:08.977 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:08.978 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:08.978 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:08.978 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:08.978 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:08.979 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:08.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.979 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "14", 2023-07-29T16:39:08.979 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:08.980 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:08.980 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:08.980 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:08.981 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:08.981 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:08.981 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:08.981 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:08.982 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:08.982 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:08.982 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:08.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:08.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:08.983 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.984 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:08.985 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.986 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.4900000095367432, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.4900000095367432, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:08.987 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:51.635875+0000", 2023-07-29T16:39:08.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2023-07-29T16:39:08.990 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:08.991 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "17", 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:08.992 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:08.993 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:08.994 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:08.995 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:08.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:08.997 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2023-07-29T16:39:08.998 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:08.999 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.690000057220459, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.690000057220459, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:09.000 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:37:52.915940+0000", 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:09.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:09.002 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2023-07-29T16:39:09.003 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:09.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:09.005 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:09.006 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:09.009 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:09.010 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5399999618530273, 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5399999618530273, 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:09.011 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.0299999713897705, 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.0299999713897705, 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "unique_pool_0", 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2023-07-29T16:38:13.069639+0000", 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2023-07-29T16:39:09.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2023-07-29T16:39:09.014 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 16, 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 16, 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 16, 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 16, 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 16, 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2023-07-29T16:39:09.015 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "21", 2023-07-29T16:39:09.016 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2023-07-29T16:39:09.017 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2023-07-29T16:39:09.018 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2023-07-29T16:39:09.019 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2023-07-29T16:39:09.020 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2023-07-29T16:39:09.021 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rados": {} 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.690000057220459, 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.690000057220459, 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2023-07-29T16:39:09.022 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:39:09.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "8b382307-786b-44f2-86db-ca9158b22127", 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:09.024 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 41, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2023-07-29T16:39:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2023-07-29T16:39:09.029 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94564 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.032 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/94564", 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/94564", 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/94564", 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/94564", 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f63dfc0a-a0cd-41f1-84c7-3a2da78625a4", 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:09.034 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 46, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:09.035 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6800", 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.036 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6801", 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6802", 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6803", 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.039 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6806", 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6807", 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.040 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6804", 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.102:6805", 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94556 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.042 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.102:6801/94556", 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.102:6803/94556", 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.102:6807/94556", 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.102:6805/94556", 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2023-07-29T16:39:09.043 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "659e5b83-bc39-4700-81b4-3cf949380228", 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 0, 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2023-07-29T16:39:09.044 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 19, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 41, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2023-07-29T16:39:09.045 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6800", 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6801", 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6802", 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6803", 2023-07-29T16:39:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6806", 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6807", 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6804", 2023-07-29T16:39:09.051 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.151:6805", 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 94718 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.151:6801/94718", 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.151:6803/94718", 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.151:6807/94718", 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.151:6805/94718", 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: "exists" 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:09.054 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.748180+0000", 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2023-07-29T16:39:09.055 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.698202+0000", 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540138322906710015, 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2023-07-29T16:39:09.057 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2023-07-29T16:37:37.720882+0000", 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 40 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "4.16", 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:39:09.058 INFO:teuthology.orchestra.run.smithi070.stdout: 1, 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: 0 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "4.19", 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: 1, 2023-07-29T16:39:09.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2023-07-29T16:39:09.060 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2023-07-29T16:39:09.061 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2023-07-29T16:39:09.062 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-07-29T16:39:09.063 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-07-29T16:39:09.064 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:09.065 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:09.065 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:09.065 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:09.065 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:09.065 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:09.066 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:09.062+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:09.067 INFO:tasks.thrashosds.thrasher:j is {'epoch': 49, 'fsid': 'c7d00049-842a-4a32-8de6-3e4b9423aea7', 'created': '2023-07-29T16:37:31.745128+0000', 'modified': '2023-07-29T16:39:08.590596+0000', 'last_up_change': '2023-07-29T16:38:52.552792+0000', 'last_in_change': '2023-07-29T16:37:32.650908+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-29T16:37:41.494530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-29T16:37:47.008107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T16:37:51.635875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T16:37:52.915940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2023-07-29T16:38:13.069639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b382307-786b-44f2-86db-ca9158b22127', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 94564}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 94564}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 94564}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 94564}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 94564}]}, 'public_addr': '172.21.15.98:6801/94564', 'cluster_addr': '172.21.15.98:6803/94564', 'heartbeat_back_addr': '172.21.15.98:6807/94564', 'heartbeat_front_addr': '172.21.15.98:6805/94564', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f63dfc0a-a0cd-41f1-84c7-3a2da78625a4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6800', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6801', 'nonce': 94556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 94556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6806', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6807', 'nonce': 94556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6804', 'nonce': 94556}, {'type': 'v1', 'addr': '172.21.15.102:6805', 'nonce': 94556}]}, 'public_addr': '172.21.15.102:6801/94556', 'cluster_addr': '172.21.15.102:6803/94556', 'heartbeat_back_addr': '172.21.15.102:6807/94556', 'heartbeat_front_addr': '172.21.15.102:6805/94556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '659e5b83-bc39-4700-81b4-3cf949380228', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 19, 'down_at': 41, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 94718}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 94718}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 94718}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 94718}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 94718}]}, 'public_addr': '172.21.15.151:6801/94718', 'cluster_addr': '172.21.15.151:6803/94718', 'heartbeat_back_addr': '172.21.15.151:6807/94718', 'heartbeat_front_addr': '172.21.15.151:6805/94718', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.748180+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.698202+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-07-29T16:37:37.720882+0000', 'dead_epoch': 40}], 'pg_upmap': [{'pgid': '4.16', 'osds': [1, 0]}, {'pgid': '4.19', 'osds': [1, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-07-29T16:39:09.068 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-07-29T16:39:09.068 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:09.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:09.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:09.079 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 53 16 126953 126937 149.677 147.062 0.00413661 0.00667846 2023-07-29T16:39:09.165 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:09.163+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:09.255 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 86.729309666999995, 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 75.304215068000005, 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 75.303955298999995, 2023-07-29T16:39:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 75.303884428999993, 2023-07-29T16:39:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.208027076, 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.175879703, 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.053577571999998, 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.836105698000001, 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.833585286, 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.83346354, 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.833221575, 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.833071321, 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.832992924999999, 2023-07-29T16:39:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.832948449, 2023-07-29T16:39:09.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:09.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:09.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.411 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.832503315, 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.412 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:09.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:09.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:09.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.832417166999999, 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.422 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:09.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.431 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.831417024, 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:09.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:09.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:09.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:09.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.831083210999999, 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.443 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:09.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.451 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.826372677, 2023-07-29T16:39:09.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:09.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:09.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.826061416, 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:09.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:09.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:09.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:09.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:09.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:09.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.470 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:09.471 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:09.471 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:09.472 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:09.470+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:09.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:09.574 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:09.572+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:09.649 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128310 5.d 5:b3299118:::benchmark_data_smithi070_97781_object128309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.639684+0000", 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0073989980000000004, 2023-07-29T16:39:09.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074190230000000003, 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128310 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639684+0000", 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639684+0000", 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639684+0000", 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639739+0000", 2023-07-29T16:39:09.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5494000000000001e-05 2023-07-29T16:39:09.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639753+0000", 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3703000000000001e-05 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639767+0000", 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4163e-05 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639805+0000", 2023-07-29T16:39:09.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7793999999999998e-05 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639923+0000", 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118238 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640067+0000", 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143621 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128311 5.d 5:b2995aa7:::benchmark_data_smithi070_97781_object128310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.639777+0000", 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0073059860000000004, 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073826200000000003, 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:09.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128311 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639777+0000", 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639777+0000", 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639777+0000", 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639803+0000", 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6631e-05 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639809+0000", 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0919999999999997e-06 2023-07-29T16:39:09.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.639812+0000", 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.765e-06 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642094+0000", 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002281777 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642240+0000", 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014573599999999999 2023-07-29T16:39:09.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:09.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642410+0000", 2023-07-29T16:39:09.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016981900000000001 2023-07-29T16:39:09.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128318 5.d 5:b26207b1:::benchmark_data_smithi070_97781_object128317:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.640116+0000", 2023-07-29T16:39:09.668 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0069670310000000003, 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070944449999999996, 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128318 2023-07-29T16:39:09.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640116+0000", 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640116+0000", 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640116+0000", 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640144+0000", 2023-07-29T16:39:09.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8394e-05 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640152+0000", 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.640159+0000", 2023-07-29T16:39:09.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3779999999999998e-06 2023-07-29T16:39:09.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644298+0000", 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041388730000000004 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644386+0000", 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8623999999999997e-05 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644529+0000", 2023-07-29T16:39:09.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014243799999999999 2023-07-29T16:39:09.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.677 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128321 5.d 5:bb575776:::benchmark_data_smithi070_97781_object128320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.642234+0000", 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004849557, 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050202140000000003, 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128321 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642234+0000", 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642234+0000", 2023-07-29T16:39:09.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642233+0000", 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642282+0000", 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9211e-05 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642291+0000", 2023-07-29T16:39:09.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2699999999999993e-06 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.642297+0000", 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6690000000000003e-06 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646058+0000", 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037603939999999998 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646388+0000", 2023-07-29T16:39:09.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033088399999999998 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646573+0000", 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018462400000000001 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128323 5.a 5:5c1a1392:::benchmark_data_smithi070_97781_object128322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.643252+0000", 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0038309300000000002, 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040431670000000003, 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.688 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128323 2023-07-29T16:39:09.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643252+0000", 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643252+0000", 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643251+0000", 2023-07-29T16:39:09.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643309+0000", 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7398000000000002e-05 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643323+0000", 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4202000000000001e-05 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643333+0000", 2023-07-29T16:39:09.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0244999999999999e-05 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643372+0000", 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8491000000000001e-05 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643463+0000", 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1211999999999993e-05 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128325 5.e 5:7b2c2816:::benchmark_data_smithi070_97781_object128324:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.643670+0000", 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0034134859999999999, 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036638220000000002, 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128325 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643670+0000", 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643670+0000", 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643669+0000", 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643738+0000", 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9737e-05 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643748+0000", 2023-07-29T16:39:09.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5519999999999993e-06 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643753+0000", 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4060000000000004e-06 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643802+0000", 2023-07-29T16:39:09.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8680999999999997e-05 2023-07-29T16:39:09.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643959+0000", 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015714099999999999 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128327 5.4 5:241242d6:::benchmark_data_smithi070_97781_object128326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.643894+0000", 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0031891390000000001, 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034772000000000002, 2023-07-29T16:39:09.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128327 2023-07-29T16:39:09.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.706 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:09.704+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:09.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643894+0000", 2023-07-29T16:39:09.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643894+0000", 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643894+0000", 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643958+0000", 2023-07-29T16:39:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-05 2023-07-29T16:39:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643964+0000", 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9920000000000004e-06 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.643971+0000", 2023-07-29T16:39:09.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4710000000000004e-06 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644006+0000", 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5222000000000003e-05 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644120+0000", 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114096 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:128324 5.9 e49/19 5:9d391423:::benchmark_data_smithi070_97781_object128323:head v 49'8015, mlcod=49'8013)", 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.644112+0000", 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029710069999999999, 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032973759999999999, 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644112+0000", 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644112+0000", 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644112+0000", 2023-07-29T16:39:09.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644173+0000", 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1710000000000004e-05 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644181+0000", 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3459999999999996e-06 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644186+0000", 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2939999999999996e-06 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644219+0000", 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3327999999999997e-05 2023-07-29T16:39:09.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644240+0000", 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0421e-05 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128329 5.8 5:131c31c6:::benchmark_data_smithi070_97781_object128328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.644387+0000", 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0026962319999999998, 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030570129999999999, 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128329 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644387+0000", 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644387+0000", 2023-07-29T16:39:09.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644386+0000", 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644456+0000", 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0133000000000001e-05 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644465+0000", 2023-07-29T16:39:09.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7010000000000002e-06 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.644473+0000", 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7049999999999999e-06 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.645642+0000", 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001169196 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.645774+0000", 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013221000000000001 2023-07-29T16:39:09.727 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:128330 5.f e49/19 5:f10646e5:::benchmark_data_smithi070_97781_object128329:head v 49'7928, mlcod=49'7926)", 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.646015+0000", 2023-07-29T16:39:09.728 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001068325, 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014648339999999999, 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646015+0000", 2023-07-29T16:39:09.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646015+0000", 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646014+0000", 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646064+0000", 2023-07-29T16:39:09.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9731000000000002e-05 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646073+0000", 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8079999999999994e-06 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646080+0000", 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8759999999999999e-06 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646115+0000", 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5284000000000003e-05 2023-07-29T16:39:09.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646134+0000", 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9344999999999999e-05 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:128333 5.b 5:dee734cd:::benchmark_data_smithi070_97781_object128332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:09.646731+0000", 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00035208100000000002, 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078286000000000002, 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:09.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 128333 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:09.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646731+0000", 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646731+0000", 2023-07-29T16:39:09.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646730+0000", 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646793+0000", 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2885999999999994e-05 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646803+0000", 2023-07-29T16:39:09.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4539999999999996e-06 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646808+0000", 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5160000000000002e-06 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646853+0000", 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4526e-05 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:09.646991+0000", 2023-07-29T16:39:09.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138317 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 11 2023-07-29T16:39:09.742 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:09.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:09.807 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:09.805+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:09.908 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:09.906+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:09.920 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:09.920 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:09.921 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:09.921 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:09.921 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:09.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:10.010 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.008+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.079 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 54 16 129364 129348 149.695 150.688 0.00392849 0.00667781 2023-07-29T16:39:10.111 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.109+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.147 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:10.147 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.092812149, 2023-07-29T16:39:10.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:10.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:10.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.092728318999999, 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:10.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:10.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:10.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.090185353999999, 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:10.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.170 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:10.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:10.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:10.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:10.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.075425308, 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:10.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:10.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:10.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.047899262000001, 2023-07-29T16:39:10.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:10.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:10.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.200 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.047739457999999, 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.201 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:10.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:10.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:10.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:10.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:10.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.043612306, 2023-07-29T16:39:10.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.212 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:10.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:10.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:10.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:10.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:10.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:10.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.222 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.037965500999999, 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.223 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:10.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:10.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:10.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.992976208000002, 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:10.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:10.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:10.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:10.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.935893301, 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:10.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:10.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:10.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.935819217999999, 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:10.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:10.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:10.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:10.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:10.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:10.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:10.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:10.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.935620802999999, 2023-07-29T16:39:10.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:10.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:10.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:10.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:10.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.282 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.935239484, 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:10.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:10.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:10.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.295 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:10.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:10.295 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.933846361000001, 2023-07-29T16:39:10.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:10.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:10.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:10.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:10.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:10.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:10.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.305 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 12.458650533, 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:10.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.898352773, 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5186995510000001, 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8301463849999999, 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8252519039999999, 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8235841580000001, 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:10.371 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:10.373 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.371+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:10.473 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.472+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.555 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:10.555 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:10.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.555 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130461 5.1 5:877cfe07:::benchmark_data_smithi070_97781_object130460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.545346+0000", 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0066411250000000003, 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066704629999999997, 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130461 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545346+0000", 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545346+0000", 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545346+0000", 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545377+0000", 2023-07-29T16:39:10.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1649999999999997e-05 2023-07-29T16:39:10.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545385+0000", 2023-07-29T16:39:10.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2620000000000001e-06 2023-07-29T16:39:10.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545390+0000", 2023-07-29T16:39:10.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0969999999999996e-06 2023-07-29T16:39:10.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.548316+0000", 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029264299999999998 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.548449+0000", 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013261999999999999 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.565 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130462 5.7 5:e93c9614:::benchmark_data_smithi070_97781_object130461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.565 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.545396+0000", 2023-07-29T16:39:10.565 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0065910129999999997, 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066950600000000001, 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.567 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130462 2023-07-29T16:39:10.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.567 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545396+0000", 2023-07-29T16:39:10.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545396+0000", 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545396+0000", 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545422+0000", 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6313e-05 2023-07-29T16:39:10.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545428+0000", 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2999999999999998e-06 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.545434+0000", 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2610000000000001e-06 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547688+0000", 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022544470000000001 2023-07-29T16:39:10.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547819+0000", 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000130922 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130463 5.5 5:ac316592:::benchmark_data_smithi070_97781_object130462:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.547770+0000", 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004217134, 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043918189999999999, 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.574 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130463 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547770+0000", 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547770+0000", 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547769+0000", 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547837+0000", 2023-07-29T16:39:10.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8288999999999996e-05 2023-07-29T16:39:10.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547846+0000", 2023-07-29T16:39:10.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9630000000000004e-06 2023-07-29T16:39:10.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547853+0000", 2023-07-29T16:39:10.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9430000000000003e-06 2023-07-29T16:39:10.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547889+0000", 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6041000000000003e-05 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.547965+0000", 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5712999999999998e-05 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130466 5.5 5:a94b85f8:::benchmark_data_smithi070_97781_object130465:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.549616+0000", 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0023715289999999998, 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026137980000000001, 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130466 2023-07-29T16:39:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549616+0000", 2023-07-29T16:39:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549616+0000", 2023-07-29T16:39:10.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549615+0000", 2023-07-29T16:39:10.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549673+0000", 2023-07-29T16:39:10.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8328000000000001e-05 2023-07-29T16:39:10.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549683+0000", 2023-07-29T16:39:10.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8179999999999999e-06 2023-07-29T16:39:10.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549691+0000", 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0469999999999994e-06 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549780+0000", 2023-07-29T16:39:10.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8703999999999996e-05 2023-07-29T16:39:10.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549889+0000", 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109054 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130467 5.6 5:68c8ee8c:::benchmark_data_smithi070_97781_object130466:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.549704+0000", 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0022832479999999999, 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002601637, 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.594 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130467 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549704+0000", 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549704+0000", 2023-07-29T16:39:10.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549703+0000", 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549742+0000", 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8869999999999999e-05 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549750+0000", 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4590000000000001e-06 2023-07-29T16:39:10.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549757+0000", 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.08e-06 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549882+0000", 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012522999999999999 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550010+0000", 2023-07-29T16:39:10.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000128233 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130468 5.7 5:ebf30528:::benchmark_data_smithi070_97781_object130467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.601 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.549768+0000", 2023-07-29T16:39:10.602 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0022195029999999998, 2023-07-29T16:39:10.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026101039999999998, 2023-07-29T16:39:10.602 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.603 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.603 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.603 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130468 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549768+0000", 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549768+0000", 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549767+0000", 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549803+0000", 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5775000000000002e-05 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549810+0000", 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.323e-06 2023-07-29T16:39:10.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549817+0000", 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4710000000000004e-06 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549881+0000", 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3872000000000001e-05 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.549995+0000", 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114393 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.610 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130469 5.9 5:942b7bab:::benchmark_data_smithi070_97781_object130468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.611 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.550029+0000", 2023-07-29T16:39:10.611 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0019578920000000001, 2023-07-29T16:39:10.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024163940000000001, 2023-07-29T16:39:10.611 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.611 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:10.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.612 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130469 2023-07-29T16:39:10.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.613 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550029+0000", 2023-07-29T16:39:10.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550029+0000", 2023-07-29T16:39:10.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550028+0000", 2023-07-29T16:39:10.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550130+0000", 2023-07-29T16:39:10.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010179999999999999 2023-07-29T16:39:10.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550146+0000", 2023-07-29T16:39:10.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.5868000000000001e-05 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550155+0000", 2023-07-29T16:39:10.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6130000000000004e-06 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550320+0000", 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016578599999999999 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550443+0000", 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012311399999999999 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550598+0000", 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000154621 2023-07-29T16:39:10.623 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:130452 5.9 e49/19)", 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.550320+0000", 2023-07-29T16:39:10.624 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001667298, 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021974759999999999, 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550320+0000", 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550320+0000", 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550320+0000", 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550322+0000", 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9399999999999998e-06 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550329+0000", 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5869999999999998e-06 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550334+0000", 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0170000000000004e-06 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.552508+0000", 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021736020000000002 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130471 5.1 5:819f2bea:::benchmark_data_smithi070_97781_object130470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.630 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.550295+0000", 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001692112, 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022839179999999998, 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.631 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130471 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550295+0000", 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550295+0000", 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550294+0000", 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550485+0000", 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019097100000000001 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550495+0000", 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7969999999999995e-06 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550503+0000", 2023-07-29T16:39:10.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.644e-06 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.552495+0000", 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019926810000000001 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.637 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130473 5.f 5:fb0557ca:::benchmark_data_smithi070_97781_object130472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.550635+0000", 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001352296, 2023-07-29T16:39:10.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020062589999999998, 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130473 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.639 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550635+0000", 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550635+0000", 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550634+0000", 2023-07-29T16:39:10.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550729+0000", 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4469999999999995e-05 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550741+0000", 2023-07-29T16:39:10.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2011000000000001e-05 2023-07-29T16:39:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550750+0000", 2023-07-29T16:39:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6290000000000005e-06 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550789+0000", 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8534000000000001e-05 2023-07-29T16:39:10.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.550911+0000", 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121798 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551042+0000", 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013154900000000001 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:130474 5.5 5:a45b8657:::benchmark_data_smithi070_97781_object130473:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:10.551593+0000", 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00039445700000000002, 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001131939, 2023-07-29T16:39:10.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 130474 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.649 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551593+0000", 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:10.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551593+0000", 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551592+0000", 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:10.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551651+0000", 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9403e-05 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:10.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551669+0000", 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7577000000000001e-05 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.551676+0000", 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5650000000000004e-06 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.552122+0000", 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00044556499999999998 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:10.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:10.552239+0000", 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117049 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 11 2023-07-29T16:39:10.655 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:10.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:10.657 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.617+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.721 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:10.719+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:10.822 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:10.820+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:10.840 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:10.841 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:10.841 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:10.841 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:10.841 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:10.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:10.923 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:10.921+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:11.024 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:11.022+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:11.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:11.076 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:11.076 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:11.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:11.076 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:11.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 88.551006095999995, 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:11.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:11.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:11.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:11.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 77.125911497000004, 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.089 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:11.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:11.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:11.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:11.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.099 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 77.125651727999994, 2023-07-29T16:39:11.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:11.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:11.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:11.111 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 77.125580858000006, 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:11.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:11.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:11.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.029723505, 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.120 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:11.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:11.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:11.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:11.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.997576131999999, 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:11.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:11.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:11.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:11.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:11.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:11.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:11.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:11.142 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.875274001000001, 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.143 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:11.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:11.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:11.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:11.153 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:11.154 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.657802127, 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:11.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:11.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:11.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.165 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.655281714999999, 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:11.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.167 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:11.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:11.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.655159969, 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.177 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:11.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:11.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.654918004000001, 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:11.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.187 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:11.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:11.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:11.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.197 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.65476775, 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:11.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.199 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:11.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:11.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.654689354, 2023-07-29T16:39:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:11.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.217 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.654644877999999, 2023-07-29T16:39:11.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:11.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:11.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:11.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.654199744, 2023-07-29T16:39:11.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:11.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:11.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:11.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:11.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.237 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.654113596, 2023-07-29T16:39:11.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:11.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:11.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:11.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:11.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.247 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.653113453, 2023-07-29T16:39:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:11.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:11.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:11.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:11.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.257 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.65277964, 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:11.258 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.259 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:11.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:11.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:11.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.648069105999999, 2023-07-29T16:39:11.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:11.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:11.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:11.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 14.647757844999999, 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:11.276 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.277 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:11.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:11.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:11.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:11.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:11.286 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.287 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.287 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:11.287 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:11.287 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:11.288 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 55 16 131735 131719 149.668 148.188 0.00637279 0.00667891 2023-07-29T16:39:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:11.290 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:11.285+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:11.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:11.291 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:11.291 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:11.291 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:11.292 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:11.292 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:11.389 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:11.386+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:11.462 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:11.463 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:11.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:11.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2023-07-29T16:39:11.489 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:11.487+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:11.591 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:11.589+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:39:11.662 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:11.662 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:11.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:11.717 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:11.715+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:11.791 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:11.789+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:11.892 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:11.890+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:11.896 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:11.896 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:11.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:11.993 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:11.990+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.079 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 56 16 134208 134192 149.755 154.562 0.00738337 0.00667496 2023-07-29T16:39:12.091 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:12.091 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:12.094 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.091+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:12.195 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.192+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.296 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:12.294+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:12.326 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:12.327 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:12.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:12.425 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.422+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.498 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:12.496+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:12.568 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:12.568 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:12.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:12.626 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:12.624+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:12.699 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.697+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.762 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:12.762 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:12.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:12.801 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.798+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.901 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:12.898+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:12.995 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:12.996 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:13.004 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:13.001+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:13.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:13.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 57 16 136725 136709 149.887 157.312 0.00896352 0.00666926 2023-07-29T16:39:13.102 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:13.100+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:13.203 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:13.201+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:13.219 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:13.219 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:13.234 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:13.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:13.310 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:13.306+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:13.407 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:13.404+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:13.412 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:13.413 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:13.429 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:13.447 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:13.466 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:13.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:13.471 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:13.508 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:13.506+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:13.615 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:13.612+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:13.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:39:13.664 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:13.665 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:13.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:13.726 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:13.723+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:13.812 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:13.810+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:13.913 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:13.913 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:13.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:13.914 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:13.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.914 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:13.914 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:13.915 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 91.386721311000002, 2023-07-29T16:39:13.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:13.915 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.915 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.916 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:13.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:13.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:13.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:13.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:13.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.929 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 79.961626711999997, 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:13.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:13.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:13.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:13.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:13.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.942 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 79.961366943000002, 2023-07-29T16:39:13.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:13.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:13.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:13.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:13.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:13.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:13.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:13.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:13.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:13.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 79.961296073, 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:13.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:13.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:13.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:13.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:13.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:13.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:13.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.86543872, 2023-07-29T16:39:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:13.970 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:13.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:13.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:13.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:13.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:13.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:13.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:13.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:13.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:13.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:13.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.833291346999999, 2023-07-29T16:39:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:13.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.985 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:13.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:13.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:13.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:13.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.996 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:13.997 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.710989216000002, 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:13.998 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:13.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:14.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:14.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:14.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:14.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.493517342000001, 2023-07-29T16:39:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:14.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:14.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:14.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:14.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:14.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:14.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.030 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490996930000001, 2023-07-29T16:39:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.031 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:14.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:14.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:14.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:14.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:14.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:14.044 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.045 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490875184, 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.046 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.047 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490633218999999, 2023-07-29T16:39:14.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.060 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:14.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:14.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:14.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:14.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:14.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:14.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:14.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:14.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490482964999998, 2023-07-29T16:39:14.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:14.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:14.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:14.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490404568999999, 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:14.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:14.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.088 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:14.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:14.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:14.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:14.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:14.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:14.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:14.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:14.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.098 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.490360093, 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:14.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:14.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:14.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:14.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:14.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:14.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:14.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:14.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.111 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.111 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:14.111 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.489914959, 2023-07-29T16:39:14.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:14.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.112 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.112 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.113 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:14.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.113 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:14.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:14.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:14.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:14.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:14.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:14.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:14.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:14.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:14.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.124 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.489828810999999, 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.125 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:14.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:14.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:14.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:14.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:14.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:14.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:14.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.488828668, 2023-07-29T16:39:14.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:14.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:14.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:14.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:14.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.488494854999999, 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:14.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.149 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:14.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:14.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:14.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:14.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:14.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:14.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:14.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:14.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:14.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:14.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:14.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:14.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:14.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:14.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:14.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:14.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.160 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.161 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:14.162 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:14.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.483784321000002, 2023-07-29T16:39:14.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:14.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:14.163 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.483473060000001, 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:14.173 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:14.174 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:14.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:14.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:14.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:14.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:14.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:14.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:14.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:14.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:14.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:14.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:14.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:14.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:14.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:14.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:14.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:14.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:14.188 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:14.189 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:14.189 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:13.910+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:14.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:14.191 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-07-29T16:39:14.191 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:39:14.192 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-07-29T16:39:14.192 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.000000 2023-07-29T16:39:14.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0 2023-07-29T16:39:14.194 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 58 16 139166 139150 149.933 152.562 0.00204898 0.006667 2023-07-29T16:39:14.194 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:14.190+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:14.293 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:14.290+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:14.371 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:139904 5.9 e50/19 5:9f99113b:::benchmark_data_smithi070_97781_object139903:head v 50'8740, mlcod=50'8738)", 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.364943+0000", 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0040816239999999998, 2023-07-29T16:39:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041056840000000001, 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364943+0000", 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364943+0000", 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364943+0000", 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.365004+0000", 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1626999999999998e-05 2023-07-29T16:39:14.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.365015+0000", 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0798999999999999e-05 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.365022+0000", 2023-07-29T16:39:14.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7429999999999996e-06 2023-07-29T16:39:14.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.365062+0000", 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0151000000000002e-05 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.365100+0000", 2023-07-29T16:39:14.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8494000000000001e-05 2023-07-29T16:39:14.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.379 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:139903 5.f e50/19 5:f1e52a92:::benchmark_data_smithi070_97781_object139902:head v 50'8645, mlcod=50'8640)", 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.366163+0000", 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028612640000000001, 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002949171, 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.380 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366163+0000", 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366163+0000", 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366163+0000", 2023-07-29T16:39:14.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366264+0000", 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010118 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366278+0000", 2023-07-29T16:39:14.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4222999999999999e-05 2023-07-29T16:39:14.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366283+0000", 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9590000000000003e-06 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366320+0000", 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6706999999999999e-05 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366340+0000", 2023-07-29T16:39:14.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9857999999999999e-05 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139906 5.4 5:21c525dd:::benchmark_data_smithi070_97781_object139905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.388 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.366189+0000", 2023-07-29T16:39:14.388 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028360199999999999, 2023-07-29T16:39:14.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029866659999999998, 2023-07-29T16:39:14.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139906 2023-07-29T16:39:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366189+0000", 2023-07-29T16:39:14.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366189+0000", 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366188+0000", 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366319+0000", 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013138000000000001 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366330+0000", 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0519e-05 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366337+0000", 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8340000000000001e-06 2023-07-29T16:39:14.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366381+0000", 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4626999999999998e-05 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.366475+0000", 2023-07-29T16:39:14.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3498999999999994e-05 2023-07-29T16:39:14.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.398 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139908 5.8 5:168f115d:::benchmark_data_smithi070_97781_object139907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.398 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.367242+0000", 2023-07-29T16:39:14.399 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0017823610000000001, 2023-07-29T16:39:14.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020028350000000001, 2023-07-29T16:39:14.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139908 2023-07-29T16:39:14.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367242+0000", 2023-07-29T16:39:14.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367242+0000", 2023-07-29T16:39:14.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367241+0000", 2023-07-29T16:39:14.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367295+0000", 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3996999999999998e-05 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367305+0000", 2023-07-29T16:39:14.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3470000000000005e-06 2023-07-29T16:39:14.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367317+0000", 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1739999999999999e-05 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367351+0000", 2023-07-29T16:39:14.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4433e-05 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367432+0000", 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0740000000000003e-05 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139910 5.a 5:55ab3a7a:::benchmark_data_smithi070_97781_object139909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.367461+0000", 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0015636000000000001, 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018514060000000001, 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139910 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367461+0000", 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367461+0000", 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367461+0000", 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367539+0000", 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8011999999999998e-05 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367546+0000", 2023-07-29T16:39:14.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8469999999999996e-06 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367551+0000", 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7010000000000004e-06 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367595+0000", 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3544000000000002e-05 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367711+0000", 2023-07-29T16:39:14.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116724 2023-07-29T16:39:14.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139911 5.b 5:d0a9f31c:::benchmark_data_smithi070_97781_object139910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.367560+0000", 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001464595, 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018178999999999999, 2023-07-29T16:39:14.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139911 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367560+0000", 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367560+0000", 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367560+0000", 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367621+0000", 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1465999999999997e-05 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367627+0000", 2023-07-29T16:39:14.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3850000000000001e-06 2023-07-29T16:39:14.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367630+0000", 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7749999999999999e-06 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367666+0000", 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5760000000000003e-05 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367778+0000", 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111684 2023-07-29T16:39:14.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139915 5.d 5:b62d6306:::benchmark_data_smithi070_97781_object139914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.367896+0000", 2023-07-29T16:39:14.426 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0011282969999999999, 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015476140000000001, 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139915 2023-07-29T16:39:14.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.428 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367896+0000", 2023-07-29T16:39:14.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367896+0000", 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367896+0000", 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367964+0000", 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8067999999999999e-05 2023-07-29T16:39:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367970+0000", 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.502e-06 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.367973+0000", 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6990000000000001e-06 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368006+0000", 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3003999999999998e-05 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368129+0000", 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012320000000000001 2023-07-29T16:39:14.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2023-07-29T16:39:14.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368270+0000", 2023-07-29T16:39:14.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000140467 2023-07-29T16:39:14.435 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.435 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.435 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.436 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:139912 5.f e50/19 5:f88b69c6:::benchmark_data_smithi070_97781_object139911:head v 50'8646, mlcod=50'8642)", 2023-07-29T16:39:14.436 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.368034+0000", 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00099097000000000009, 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001482847, 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368034+0000", 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368034+0000", 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368033+0000", 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368099+0000", 2023-07-29T16:39:14.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5802999999999993e-05 2023-07-29T16:39:14.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368107+0000", 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9810000000000003e-06 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368113+0000", 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0870000000000003e-06 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368162+0000", 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8647999999999999e-05 2023-07-29T16:39:14.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.368180+0000", 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7895000000000001e-05 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:139901 5.0 5:0824e4de:::benchmark_data_smithi070_97781_object139900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.363154+0000", 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0058707990000000003, 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064194359999999997, 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 139901 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363154+0000", 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363154+0000", 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363153+0000", 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363254+0000", 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101481 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363268+0000", 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3932e-05 2023-07-29T16:39:14.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363277+0000", 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7479999999999999e-06 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363318+0000", 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0941e-05 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.363413+0000", 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4555999999999994e-05 2023-07-29T16:39:14.450 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:139895 5.f e50/19 5:f766c71b:::benchmark_data_smithi070_97781_object139894:head v 50'8644, mlcod=50'8640)", 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:14.364668+0000", 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0043563960000000002, 2023-07-29T16:39:14.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00497913, 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364668+0000", 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364668+0000", 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364668+0000", 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364727+0000", 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9491999999999999e-05 2023-07-29T16:39:14.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364739+0000", 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364746+0000", 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.114e-06 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364783+0000", 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6406999999999999e-05 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:14.364798+0000", 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5221999999999999e-05 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.457 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.458 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:14.458 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2023-07-29T16:39:14.458 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:14.459 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:14.460 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:14.457+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:14.559 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:14.557+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:14.611 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:39:14.613 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.0 primary-affinity to 0 (802) 2023-07-29T16:39:14.660 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:14.658+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:14.665 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:14.665 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:14.665 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:14.666 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:14.666 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:14.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:14.761 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:14.758+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:14.815 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:14.815 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:14.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.761024987999999, 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:14.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:14.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:14.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:14.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:14.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:14.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:14.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:14.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:14.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:14.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.760941158000001, 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.758398193000001, 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.743638146999999, 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.716112101, 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.715952297000001, 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.711825144999999, 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.706178340000001, 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.661189047000001, 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.604106139999999, 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.604032057000001, 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.603833642000001, 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.603452322999999, 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.602059199999999, 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:14.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.126863371999999, 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:14.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:14.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:14.981 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 12.566565612, 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.982 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:14.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:14.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:14.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.18691239, 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:14.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:14.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:14.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:14.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:14.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:14.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:14.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:14.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:14.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:14.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:15.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.001 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4983592239999997, 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:15.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:15.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:15.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:15.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.010 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4934647430000005, 2023-07-29T16:39:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.012 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:15.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:15.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:15.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:15.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:15.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:15.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4917969969999998, 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.021 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:15.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:15.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:15.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:15.030 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:15.030 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:15.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:15.032 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:15.028+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:15.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 59 16 140746 140730 149.065 98.75 0.00246571 0.00665976 2023-07-29T16:39:15.133 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:15.130+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:15.160 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5.78134f9d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.50331431599999998, 2023-07-29T16:39:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.50333417899999999, 2023-07-29T16:39:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140674 5.d 5.47dd91bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.693421+0000", 2023-07-29T16:39:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.46376144400000002, 2023-07-29T16:39:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.463823127, 2023-07-29T16:39:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140674 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693421+0000", 2023-07-29T16:39:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693421+0000", 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693420+0000", 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693497+0000", 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7087000000000002e-05 2023-07-29T16:39:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693504+0000", 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5919999999999997e-06 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693508+0000", 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5999999999999998e-06 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693550+0000", 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2138999999999998e-05 2023-07-29T16:39:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693566+0000", 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.6339000000000001e-05 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5.c68306d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.54916597099999997, 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.54926355800000004, 2023-07-29T16:39:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5.92ab06ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.54660091200000005, 2023-07-29T16:39:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.54676680799999999, 2023-07-29T16:39:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5.b9adbcbd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.54630041799999995, 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.54651008599999995, 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140612 5.d 5.1ee2d73d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.656896+0000", 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.50028642300000004, 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.50053820199999999, 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140612 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656896+0000", 2023-07-29T16:39:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656896+0000", 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656895+0000", 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656953+0000", 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7694e-05 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656959+0000", 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4489999999999996e-06 2023-07-29T16:39:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656964+0000", 2023-07-29T16:39:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2889999999999999e-06 2023-07-29T16:39:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656992+0000", 2023-07-29T16:39:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8890999999999998e-05 2023-07-29T16:39:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.656999+0000", 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1489999999999999e-06 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5.f04b437d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.52175997799999996, 2023-07-29T16:39:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.52204717, 2023-07-29T16:39:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5.ce1204bd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.52167812499999999, 2023-07-29T16:39:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.52200134200000003, 2023-07-29T16:39:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5.a667fe0d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.52076658499999995, 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.52113444600000003, 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140693 5.d 5.896e401d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.721970+0000", 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.43521172600000002, 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.43563177600000003, 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140693 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.721970+0000", 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.721970+0000", 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.721970+0000", 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722013+0000", 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2901000000000001e-05 2023-07-29T16:39:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722023+0000", 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0003000000000001e-05 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722028+0000", 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5600000000000001e-06 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722065+0000", 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7364999999999999e-05 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722073+0000", 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1019999999999999e-06 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140694 5.d 5.92cf00cd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.722174+0000", 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.43500782300000002, 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.43546182, 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140694 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722174+0000", 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722174+0000", 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722174+0000", 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722250+0000", 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6705000000000005e-05 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722258+0000", 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6459999999999993e-06 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722263+0000", 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7530000000000001e-06 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722296+0000", 2023-07-29T16:39:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3444e-05 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.722310+0000", 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3390000000000001e-05 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140663 5.d 5.8f65893d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.686289+0000", 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.470893226, 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.47138121999999999, 2023-07-29T16:39:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140663 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686289+0000", 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686289+0000", 2023-07-29T16:39:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686288+0000", 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686365+0000", 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7075000000000003e-05 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686373+0000", 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1529999999999997e-06 2023-07-29T16:39:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686379+0000", 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7740000000000001e-06 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686411+0000", 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1442999999999997e-05 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.686417+0000", 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0299999999999999e-06 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5.b146fa7d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.53151060500000002, 2023-07-29T16:39:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.53203208400000002, 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5.e1d9b51d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.53060973, 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.53116481800000004, 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140746 5.d 5.39c0ab8d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.874206+0000", 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.28297594700000001, 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.283567509, 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140746 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874206+0000", 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874206+0000", 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874206+0000", 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874230+0000", 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4615999999999999e-05 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874240+0000", 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0095000000000001e-05 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874247+0000", 2023-07-29T16:39:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1280000000000002e-06 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874281+0000", 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3529999999999999e-05 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.874287+0000", 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4300000000000003e-06 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140673 5.d 5.3c910ecd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.693342+0000", 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.46383991099999999, 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.46446532600000001, 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "delayed", 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140673 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693342+0000", 2023-07-29T16:39:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693342+0000", 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693341+0000", 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693377+0000", 2023-07-29T16:39:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5651000000000001e-05 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693387+0000", 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9979999999999998e-06 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693392+0000", 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6709999999999998e-06 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693433+0000", 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0800999999999998e-05 2023-07-29T16:39:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.693440+0000", 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8609999999999998e-06 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 16 2023-07-29T16:39:15.313 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:15.314 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:15.315 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:15.312+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:15.415 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:15.413+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:15.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:15.482 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:15.483 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:15.492 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:15.516 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:15.514+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:15.619 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:15.614+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:15.624 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4156.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 93.097841556999995, 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.026872685, 2023-07-29T16:39:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4156", 2023-07-29T16:39:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/3787524033", 2023-07-29T16:39:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 1 2023-07-29T16:39:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521488+0000", 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521486+0000", 2023-07-29T16:39:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521494+0000", 2023-07-29T16:39:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.391e-06 2023-07-29T16:39:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521505+0000", 2023-07-29T16:39:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0892e-05 2023-07-29T16:39:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521515+0000", 2023-07-29T16:39:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0747000000000001e-05 2023-07-29T16:39:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521569+0000", 2023-07-29T16:39:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3650000000000003e-05 2023-07-29T16:39:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.521581+0000", 2023-07-29T16:39:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1505000000000001e-05 2023-07-29T16:39:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547120+0000", 2023-07-29T16:39:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025539453 2023-07-29T16:39:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547284+0000", 2023-07-29T16:39:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016363799999999999 2023-07-29T16:39:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.547456+0000", 2023-07-29T16:39:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00017233099999999999 2023-07-29T16:39:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548021+0000", 2023-07-29T16:39:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056501399999999997 2023-07-29T16:39:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548268+0000", 2023-07-29T16:39:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024743399999999999 2023-07-29T16:39:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548316+0000", 2023-07-29T16:39:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7871999999999998e-05 2023-07-29T16:39:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:42.548360+0000", 2023-07-29T16:39:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4118e-05 2023-07-29T16:39:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 81.672746958000005, 2023-07-29T16:39:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.02367876, 2023-07-29T16:39:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946582+0000", 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946592+0000", 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.03e-05 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946600+0000", 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.542e-06 2023-07-29T16:39:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946606+0000", 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0560000000000001e-06 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949725+0000", 2023-07-29T16:39:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031191000000000001 2023-07-29T16:39:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.949731+0000", 2023-07-29T16:39:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7529999999999998e-06 2023-07-29T16:39:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959420+0000", 2023-07-29T16:39:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0096896810000000003 2023-07-29T16:39:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959538+0000", 2023-07-29T16:39:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118118 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959688+0000", 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000149944 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964136+0000", 2023-07-29T16:39:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004447683 2023-07-29T16:39:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970192+0000", 2023-07-29T16:39:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060562430000000002 2023-07-29T16:39:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970237+0000", 2023-07-29T16:39:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4638000000000002e-05 2023-07-29T16:39:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970261+0000", 2023-07-29T16:39:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4179999999999999e-05 2023-07-29T16:39:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 81.672487188999995, 2023-07-29T16:39:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023443104999999999, 2023-07-29T16:39:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946842+0000", 2023-07-29T16:39:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946846+0000", 2023-07-29T16:39:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2169999999999996e-06 2023-07-29T16:39:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946853+0000", 2023-07-29T16:39:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.588e-06 2023-07-29T16:39:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946859+0000", 2023-07-29T16:39:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8329999999999999e-06 2023-07-29T16:39:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947551+0000", 2023-07-29T16:39:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069139699999999995 2023-07-29T16:39:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947555+0000", 2023-07-29T16:39:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2230000000000001e-06 2023-07-29T16:39:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959056+0000", 2023-07-29T16:39:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011501292 2023-07-29T16:39:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959180+0000", 2023-07-29T16:39:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012359 2023-07-29T16:39:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959320+0000", 2023-07-29T16:39:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140784 2023-07-29T16:39:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.964033+0000", 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0047127610000000002 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970212+0000", 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061783350000000001 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970243+0000", 2023-07-29T16:39:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0998999999999999e-05 2023-07-29T16:39:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970285+0000", 2023-07-29T16:39:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2667000000000003e-05 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2023-07-29T16:39:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 81.672416319000007, 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.023474325000000001, 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946913+0000", 2023-07-29T16:39:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946912+0000", 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946915+0000", 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5840000000000002e-06 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946924+0000", 2023-07-29T16:39:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6139999999999992e-06 2023-07-29T16:39:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.946930+0000", 2023-07-29T16:39:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5300000000000002e-06 2023-07-29T16:39:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947630+0000", 2023-07-29T16:39:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069966199999999998 2023-07-29T16:39:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.947635+0000", 2023-07-29T16:39:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7160000000000002e-06 2023-07-29T16:39:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.959857+0000", 2023-07-29T16:39:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012222731000000001 2023-07-29T16:39:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.960170+0000", 2023-07-29T16:39:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00031277699999999998 2023-07-29T16:39:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:37:53.970387+0000", 2023-07-29T16:39:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010217235 2023-07-29T16:39:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89421 5.2 5:4f6e3ed9:::benchmark_data_smithi070_97781_object89420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.576558966, 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.025332120999999999, 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89421 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042770+0000", 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042826+0000", 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6949e-05 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042837+0000", 2023-07-29T16:39:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0942e-05 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.042844+0000", 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046126+0000", 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032819960000000001 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046262+0000", 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013570999999999999 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.046412+0000", 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000150753 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.047939+0000", 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015271029999999999 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.067936+0000", 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.019996881000000001 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068066+0000", 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013003299999999999 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.068102+0000", 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6063999999999999e-05 2023-07-29T16:39:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89455 5.1 5:8252419b:::benchmark_data_smithi070_97781_object89454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.544411593, 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.032528559999999998, 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89455 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074918+0000", 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.074917+0000", 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075002+0000", 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5031000000000006e-05 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075011+0000", 2023-07-29T16:39:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7490000000000004e-06 2023-07-29T16:39:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075017+0000", 2023-07-29T16:39:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4169999999999997e-06 2023-07-29T16:39:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075053+0000", 2023-07-29T16:39:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5601e-05 2023-07-29T16:39:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075150+0000", 2023-07-29T16:39:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6756999999999995e-05 2023-07-29T16:39:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.075267+0000", 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.077405+0000", 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002137477 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107389+0000", 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.029984114999999999 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107421+0000", 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2663999999999998e-05 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.107446+0000", 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.48e-05 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.422109462000002, 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.204637588000001, 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.202117176000002, 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.20199543, 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.201753464999999, 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.201603210999998, 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96640 5.6 5:621986aa:::benchmark_data_smithi070_97781_object96639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.201524814999999, 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068022086999999995, 2023-07-29T16:39:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96640 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417805+0000", 2023-07-29T16:39:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417804+0000", 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417829+0000", 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5177999999999998e-05 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417836+0000", 2023-07-29T16:39:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4609999999999996e-06 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417840+0000", 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8470000000000003e-06 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417880+0000", 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9839999999999998e-05 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417993+0000", 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011253599999999999 2023-07-29T16:39:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485746+0000", 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.067753300000000002 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485780+0000", 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3957e-05 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.485827+0000", 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6468000000000003e-05 2023-07-29T16:39:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.201480339, 2023-07-29T16:39:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.201035205, 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.200949056999999, 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.199948914, 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.199615100999999, 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:96638 5.f e42/19 ondisk, result = 0)", 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.194904566999998, 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059778209999999998, 2023-07-29T16:39:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424425+0000", 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424424+0000", 2023-07-29T16:39:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424429+0000", 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6029999999999998e-06 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483673+0000", 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.059244183999999998 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483680+0000", 2023-07-29T16:39:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4599999999999997e-06 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484185+0000", 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000504957 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484194+0000", 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5010000000000004e-06 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484203+0000", 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1009999999999998e-06 2023-07-29T16:39:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96652 5.9 5:974d53b7:::benchmark_data_smithi070_97781_object96651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.194593306000002, 2023-07-29T16:39:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066276961999999995, 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96652 2023-07-29T16:39:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424736+0000", 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424735+0000", 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.424762+0000", 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7393e-05 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483668+0000", 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.058905476999999998 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483681+0000", 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2833999999999999e-05 2023-07-29T16:39:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483735+0000", 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4342999999999998e-05 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483887+0000", 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015142199999999999 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484017+0000", 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013091700000000001 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488398+0000", 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043807810000000003 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490934+0000", 2023-07-29T16:39:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025358960000000002 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4805999999999998e-05 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491013+0000", 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4008999999999999e-05 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:15.858 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:15.859 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:15.859 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:15.860 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:15.856+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:15.860 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:15.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:15.861 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:15.861 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:15.861 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:15.862 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:15.959 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:15.957+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:16.031 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.031 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.045 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:16.079 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:2023-07-29T16:39:16.078444+0000 min lat: 0.00112574 max lat: 1.03816 avg lat: 0.00676917 2023-07-29T16:39:16.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2023-07-29T16:39:16.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout: 60 8 141782 141774 147.668 65.25 0.0119414 0.00676917 2023-07-29T16:39:16.087 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:16.084+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:16.161 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.159+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:16.212 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.213 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:16.267 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:16.265+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:16.349 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.350 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:16.362 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.360+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:16.463 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.461+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:16.487 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.487 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.498 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:16.565 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:16.563+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:16.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:39:16.663 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.663 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.666 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:16.664+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:16.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:16.768 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.765+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:16.802 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.803 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.813 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:16.869 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.867+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:16.943 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:16.944 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:16.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:16.971 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:16.967+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.071 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:17.069+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:17.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Total time run: 60.007 2023-07-29T16:39:17.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Total writes made: 141782 2023-07-29T16:39:17.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Write size: 65536 2023-07-29T16:39:17.080 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Object size: 65536 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Bandwidth (MB/sec): 147.672 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Stddev Bandwidth: 34.3784 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Max bandwidth (MB/sec): 268.625 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Min bandwidth (MB/sec): 47.875 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Average IOPS: 2362 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Stddev IOPS: 550.054 2023-07-29T16:39:17.081 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Max IOPS: 4298 2023-07-29T16:39:17.082 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Min IOPS: 766 2023-07-29T16:39:17.082 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Average Latency(s): 0.0067694 2023-07-29T16:39:17.082 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Stddev Latency(s): 0.0152986 2023-07-29T16:39:17.082 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Max latency(s): 1.03816 2023-07-29T16:39:17.082 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Min latency(s): 0.00112574 2023-07-29T16:39:17.083 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:17.083 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:17.087 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Cleaning up (deleting benchmark objects) 2023-07-29T16:39:17.096 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:17.179 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:17.177+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:17.273 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:17.270+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2023-07-29T16:39:17.296 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:17.297 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:17.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:17.374 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:17.371+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.475 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:17.473+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:17.491 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:17.491 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:17.505 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:17.589 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:17.585+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.622 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:39:17.677 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:17.674+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.730 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:17.731 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:17.744 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:17.787 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:17.784+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:17.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:17.879 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:17.877+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:17.966 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:17.967 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:17.980 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:17.978+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:17.984 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:18.015 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:18.036 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:18.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:18.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:18.037 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:18.038 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:18.038 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:18.081 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:18.079+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:18.163 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144754 5.8 5:1e30a985:::benchmark_data_smithi070_97781_object2969:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.151088+0000", 2023-07-29T16:39:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0099326599999999994, 2023-07-29T16:39:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099518100000000002, 2023-07-29T16:39:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144754 2023-07-29T16:39:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151088+0000", 2023-07-29T16:39:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151088+0000", 2023-07-29T16:39:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151088+0000", 2023-07-29T16:39:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151090+0000", 2023-07-29T16:39:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9190000000000002e-06 2023-07-29T16:39:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151095+0000", 2023-07-29T16:39:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749999999999996e-06 2023-07-29T16:39:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.151099+0000", 2023-07-29T16:39:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3869999999999997e-06 2023-07-29T16:39:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.152786+0000", 2023-07-29T16:39:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001686604 2023-07-29T16:39:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.152887+0000", 2023-07-29T16:39:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010178099999999999 2023-07-29T16:39:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144760 5.8 5:1c8e7491:::benchmark_data_smithi070_97781_object2975:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.154433+0000", 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0065873659999999999, 2023-07-29T16:39:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006654882, 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144760 2023-07-29T16:39:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154433+0000", 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154433+0000", 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154432+0000", 2023-07-29T16:39:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154437+0000", 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-06 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154450+0000", 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3269e-05 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154458+0000", 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7780000000000007e-06 2023-07-29T16:39:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154717+0000", 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025839899999999998 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.154862+0000", 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145382 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144762 5.8 5:185a015c:::benchmark_data_smithi070_97781_object2977:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.155093+0000", 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0059277610000000001, 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060341709999999996, 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144762 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155093+0000", 2023-07-29T16:39:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155093+0000", 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155092+0000", 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155097+0000", 2023-07-29T16:39:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5510000000000001e-06 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155107+0000", 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0614999999999999e-05 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155116+0000", 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3499999999999997e-06 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156166+0000", 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001050573 2023-07-29T16:39:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156304+0000", 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013768799999999999 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144763 5.8 5:1f0dac4a:::benchmark_data_smithi070_97781_object2978:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.155125+0000", 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0058958070000000003, 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006048772, 2023-07-29T16:39:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144763 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155125+0000", 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155125+0000", 2023-07-29T16:39:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155124+0000", 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155127+0000", 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8389999999999998e-06 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155136+0000", 2023-07-29T16:39:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7309999999999999e-06 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155148+0000", 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2217e-05 2023-07-29T16:39:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.158029+0000", 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028804 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.158166+0000", 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013795600000000001 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144764 5.0 5:02c86fc2:::benchmark_data_smithi070_97781_object2979:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.155159+0000", 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0058618120000000001, 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060607880000000001, 2023-07-29T16:39:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144764 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155159+0000", 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155159+0000", 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155158+0000", 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155161+0000", 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1550000000000001e-06 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155167+0000", 2023-07-29T16:39:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9299999999999997e-06 2023-07-29T16:39:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.155171+0000", 2023-07-29T16:39:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2023-07-29T16:39:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.158015+0000", 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028437879999999999 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.158185+0000", 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016988699999999999 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144767 5.8 5:1e59afc6:::benchmark_data_smithi070_97781_object2982:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.156502+0000", 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0045190580000000003, 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048055110000000002, 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144767 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156502+0000", 2023-07-29T16:39:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156502+0000", 2023-07-29T16:39:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156501+0000", 2023-07-29T16:39:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156504+0000", 2023-07-29T16:39:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.072e-06 2023-07-29T16:39:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156514+0000", 2023-07-29T16:39:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0209e-05 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.156521+0000", 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1590000000000004e-06 2023-07-29T16:39:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159530+0000", 2023-07-29T16:39:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030082289999999999 2023-07-29T16:39:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159653+0000", 2023-07-29T16:39:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012334600000000001 2023-07-29T16:39:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144769 5.e 5:7a6a549b:::benchmark_data_smithi070_97781_object2984:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.157400+0000", 2023-07-29T16:39:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0036202510000000001, 2023-07-29T16:39:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039842660000000002, 2023-07-29T16:39:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144769 2023-07-29T16:39:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157400+0000", 2023-07-29T16:39:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157400+0000", 2023-07-29T16:39:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157399+0000", 2023-07-29T16:39:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157405+0000", 2023-07-29T16:39:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5160000000000002e-06 2023-07-29T16:39:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157418+0000", 2023-07-29T16:39:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3498e-05 2023-07-29T16:39:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157429+0000", 2023-07-29T16:39:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.03e-05 2023-07-29T16:39:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157475+0000", 2023-07-29T16:39:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6653000000000002e-05 2023-07-29T16:39:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.157617+0000", 2023-07-29T16:39:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014115899999999999 2023-07-29T16:39:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144775 5.e 5:7dd06f9c:::benchmark_data_smithi070_97781_object2990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.159458+0000", 2023-07-29T16:39:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0015629820000000001, 2023-07-29T16:39:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020065880000000001, 2023-07-29T16:39:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144775 2023-07-29T16:39:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159458+0000", 2023-07-29T16:39:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159458+0000", 2023-07-29T16:39:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159457+0000", 2023-07-29T16:39:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159465+0000", 2023-07-29T16:39:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8630000000000008e-06 2023-07-29T16:39:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159476+0000", 2023-07-29T16:39:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.118e-05 2023-07-29T16:39:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159483+0000", 2023-07-29T16:39:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8050000000000001e-06 2023-07-29T16:39:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159520+0000", 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7474000000000001e-05 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159635+0000", 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114684 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144777 5.a 5:5c257441:::benchmark_data_smithi070_97781_object2992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.159587+0000", 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001433503, 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019529860000000001, 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144777 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159587+0000", 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159587+0000", 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159587+0000", 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159590+0000", 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3869999999999999e-06 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159597+0000", 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3849999999999996e-06 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.159611+0000", 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3851e-05 2023-07-29T16:39:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160087+0000", 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047547399999999998 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160209+0000", 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012275200000000001 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144778 5.a 5.321831ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.160183+0000", 2023-07-29T16:39:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00083807200000000004, 2023-07-29T16:39:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001436016, 2023-07-29T16:39:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144778 2023-07-29T16:39:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160183+0000", 2023-07-29T16:39:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160183+0000", 2023-07-29T16:39:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160182+0000", 2023-07-29T16:39:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160187+0000", 2023-07-29T16:39:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3839999999999996e-06 2023-07-29T16:39:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160198+0000", 2023-07-29T16:39:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0509000000000001e-05 2023-07-29T16:39:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.160205+0000", 2023-07-29T16:39:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7279999999999995e-06 2023-07-29T16:39:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144779 5.b 5:ddcd603c:::benchmark_data_smithi070_97781_object2994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.161389+0000", 2023-07-29T16:39:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9996319, 2023-07-29T16:39:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029702599999999998, 2023-07-29T16:39:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144779 2023-07-29T16:39:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161389+0000", 2023-07-29T16:39:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161389+0000", 2023-07-29T16:39:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161388+0000", 2023-07-29T16:39:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161393+0000", 2023-07-29T16:39:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.938e-06 2023-07-29T16:39:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161402+0000", 2023-07-29T16:39:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9360000000000005e-06 2023-07-29T16:39:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161410+0000", 2023-07-29T16:39:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1869999999999997e-06 2023-07-29T16:39:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161448+0000", 2023-07-29T16:39:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8172e-05 2023-07-29T16:39:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161568+0000", 2023-07-29T16:39:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011950700000000001 2023-07-29T16:39:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144781 5.e 5:7f089816:::benchmark_data_smithi070_97781_object2996:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.161428+0000", 2023-07-29T16:39:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9995923, 2023-07-29T16:39:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033881500000000001, 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144781 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161428+0000", 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161428+0000", 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161428+0000", 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161432+0000", 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8820000000000003e-06 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161439+0000", 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161444+0000", 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6740000000000002e-06 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161568+0000", 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123888 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161689+0000", 2023-07-29T16:39:18.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120754 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:144782 5.e 5.54d4866e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:18.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:18.161468+0000", 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9995522, 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037180399999999999, 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 144782 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161468+0000", 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161468+0000", 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161468+0000", 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161471+0000", 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2289999999999999e-06 2023-07-29T16:39:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161478+0000", 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8909999999999998e-06 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:18.161484+0000", 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5589999999999996e-06 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 13 2023-07-29T16:39:18.301 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:18.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:18.303 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:18.301+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:18.403 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:18.400+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:18.503 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:18.501+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:18.508 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:18.508 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:18.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:18.604 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:18.602+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:18.687 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.633488558, 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.633404727999999, 2023-07-29T16:39:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.630861762999999, 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.616101716999999, 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.588575671000001, 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.588415866999998, 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.584288715, 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.578641910000002, 2023-07-29T16:39:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.533652617000001, 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.47656971, 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.476495626999998, 2023-07-29T16:39:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.476297211999999, 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.475915893, 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.47452277, 2023-07-29T16:39:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.999326942, 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.439029181999999, 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.059375960000001, 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.370822794, 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.365928313, 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.364260567000001, 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:18.915 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:18.916 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:18.913+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:18.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:19.017 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:19.014+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:19.096 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:19.096 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:19.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147470 5.5 5:aba1b634:::benchmark_data_smithi070_97781_object5685:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.084089+0000", 2023-07-29T16:39:19.098 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0089608629999999995, 2023-07-29T16:39:19.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0089786750000000002, 2023-07-29T16:39:19.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.098 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.099 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147470 2023-07-29T16:39:19.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084089+0000", 2023-07-29T16:39:19.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084089+0000", 2023-07-29T16:39:19.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084088+0000", 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084092+0000", 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1420000000000003e-06 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084098+0000", 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000001e-06 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084102+0000", 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1150000000000004e-06 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.089244+0000", 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005142593 2023-07-29T16:39:19.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.089373+0000", 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012854500000000001 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147471 5.d 5:b9ae2327:::benchmark_data_smithi070_97781_object5686:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.084557+0000", 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0084931980000000004, 2023-07-29T16:39:19.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0085566159999999995, 2023-07-29T16:39:19.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.109 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:19.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.110 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147471 2023-07-29T16:39:19.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.110 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084557+0000", 2023-07-29T16:39:19.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084557+0000", 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084556+0000", 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084559+0000", 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1930000000000002e-06 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084566+0000", 2023-07-29T16:39:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7510000000000002e-06 2023-07-29T16:39:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.084570+0000", 2023-07-29T16:39:19.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8870000000000002e-06 2023-07-29T16:39:19.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.089230+0000", 2023-07-29T16:39:19.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046597629999999999 2023-07-29T16:39:19.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.089354+0000", 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012484700000000001 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.089464+0000", 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109777 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.120 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147472 5.5 5:aeb70034:::benchmark_data_smithi070_97781_object5687:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.120 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.085348+0000", 2023-07-29T16:39:19.120 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0077019899999999997, 2023-07-29T16:39:19.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078071269999999996, 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147472 2023-07-29T16:39:19.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085348+0000", 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085348+0000", 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085347+0000", 2023-07-29T16:39:19.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085352+0000", 2023-07-29T16:39:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2023-07-29T16:39:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085360+0000", 2023-07-29T16:39:19.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4749999999999993e-06 2023-07-29T16:39:19.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085367+0000", 2023-07-29T16:39:19.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8449999999999997e-06 2023-07-29T16:39:19.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090746+0000", 2023-07-29T16:39:19.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053790390000000004 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090867+0000", 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000120586 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147475 5.5 5:a18ffa83:::benchmark_data_smithi070_97781_object5690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.086249+0000", 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0068008180000000001, 2023-07-29T16:39:19.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.006943154, 2023-07-29T16:39:19.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147475 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086249+0000", 2023-07-29T16:39:19.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086249+0000", 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086248+0000", 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086253+0000", 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.237e-06 2023-07-29T16:39:19.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086264+0000", 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0572e-05 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086272+0000", 2023-07-29T16:39:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2910000000000007e-06 2023-07-29T16:39:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092324+0000", 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060513160000000002 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092467+0000", 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000143774 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.139 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147477 5.5 5.18d46d25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.140 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.087498+0000", 2023-07-29T16:39:19.140 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0055512390000000003, 2023-07-29T16:39:19.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0057300659999999998, 2023-07-29T16:39:19.140 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147477 2023-07-29T16:39:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.142 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087498+0000", 2023-07-29T16:39:19.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087498+0000", 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087498+0000", 2023-07-29T16:39:19.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087502+0000", 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8060000000000001e-06 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087509+0000", 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7049999999999999e-06 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087516+0000", 2023-07-29T16:39:19.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5470000000000002e-06 2023-07-29T16:39:19.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.147 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147484 5.f 5:fb0e70a3:::benchmark_data_smithi070_97781_object5699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.090334+0000", 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0027156229999999999, 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029256199999999999, 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147484 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090334+0000", 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090334+0000", 2023-07-29T16:39:19.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090333+0000", 2023-07-29T16:39:19.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090338+0000", 2023-07-29T16:39:19.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.933e-06 2023-07-29T16:39:19.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090350+0000", 2023-07-29T16:39:19.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.129e-05 2023-07-29T16:39:19.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090357+0000", 2023-07-29T16:39:19.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7200000000000006e-06 2023-07-29T16:39:19.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090398+0000", 2023-07-29T16:39:19.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0485000000000003e-05 2023-07-29T16:39:19.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090528+0000", 2023-07-29T16:39:19.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000130238 2023-07-29T16:39:19.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.090641+0000", 2023-07-29T16:39:19.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113282 2023-07-29T16:39:19.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147485 5.f 5:f9b7244f:::benchmark_data_smithi070_97781_object5700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.092567+0000", 2023-07-29T16:39:19.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00048265899999999997, 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073985800000000003, 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.163 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147485 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092567+0000", 2023-07-29T16:39:19.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092567+0000", 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092566+0000", 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092571+0000", 2023-07-29T16:39:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1389999999999997e-06 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092581+0000", 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0913e-05 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092586+0000", 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.814e-06 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092623+0000", 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6702000000000002e-05 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092739+0000", 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116255 2023-07-29T16:39:19.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092852+0000", 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000113193 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147486 5.5 5.94a39565 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.092595+0000", 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00045450999999999998, 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00075252900000000005, 2023-07-29T16:39:19.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147486 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.172 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092595+0000", 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092595+0000", 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092595+0000", 2023-07-29T16:39:19.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092597+0000", 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.559e-06 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092602+0000", 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5070000000000002e-06 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092605+0000", 2023-07-29T16:39:19.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.044e-06 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147457 5.5 5:ab2b4f7f:::benchmark_data_smithi070_97781_object5672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.177 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.080995+0000", 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.012054375000000001, 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012383754, 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147457 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.080995+0000", 2023-07-29T16:39:19.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.080995+0000", 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.080995+0000", 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.080999+0000", 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8860000000000003e-06 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081008+0000", 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5129999999999996e-06 2023-07-29T16:39:19.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081015+0000", 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7009999999999999e-06 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.083868+0000", 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002853141 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.083982+0000", 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114029 2023-07-29T16:39:19.184 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147487 5.5 5.a51410f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.092610+0000", 2023-07-29T16:39:19.185 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00044004599999999998, 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000815663, 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147487 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092610+0000", 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092610+0000", 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092609+0000", 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092611+0000", 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.934e-06 2023-07-29T16:39:19.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092615+0000", 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0770000000000001e-06 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092620+0000", 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4909999999999999e-06 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147458 5.5 5:a975d655:::benchmark_data_smithi070_97781_object5673:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.081021+0000", 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.012028779999999999, 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012437035000000001, 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.192 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147458 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081021+0000", 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081021+0000", 2023-07-29T16:39:19.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081021+0000", 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081023+0000", 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5550000000000001e-06 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081029+0000", 2023-07-29T16:39:19.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8660000000000002e-06 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081034+0000", 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9810000000000003e-06 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.085982+0000", 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.004947697 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.086107+0000", 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012528699999999999 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147488 5.7 5:ec7fb529:::benchmark_data_smithi070_97781_object5703:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.092623+0000", 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.000427167, 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00087869, 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147488 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092623+0000", 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092623+0000", 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092622+0000", 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967296 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092624+0000", 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.562e-06 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092627+0000", 2023-07-29T16:39:19.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2949999999999998e-06 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092632+0000", 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9450000000000001e-06 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092664+0000", 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1761999999999998e-05 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.092746+0000", 2023-07-29T16:39:19.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2132000000000006e-05 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147459 5.5 5:a45f4211:::benchmark_data_smithi070_97781_object5674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.207 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.081046+0000", 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.012003326999999999, 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.01249303, 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.208 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147459 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081046+0000", 2023-07-29T16:39:19.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081046+0000", 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081046+0000", 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081049+0000", 2023-07-29T16:39:19.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6759999999999999e-06 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081054+0000", 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8499999999999999e-06 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.081061+0000", 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3820000000000001e-06 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087627+0000", 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0065660739999999999 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.087759+0000", 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000132082 2023-07-29T16:39:19.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:147489 5.3 5:c6bc0875:::benchmark_data_smithi070_97781_object5704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:19.093346+0000", 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9997039, 2023-07-29T16:39:19.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000236307, 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.216 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 147489 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093346+0000", 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093346+0000", 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093345+0000", 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093350+0000", 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1370000000000001e-06 2023-07-29T16:39:19.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093363+0000", 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2479e-05 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093370+0000", 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1040000000000001e-06 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093422+0000", 2023-07-29T16:39:19.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1972999999999999e-05 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:19.093556+0000", 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013371999999999999 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:19.223 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 14 2023-07-29T16:39:19.223 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:19.225 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:19.225 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:19.221+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:19.325 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:19.322+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:19.426 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:19.424+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:19.447 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:19.447 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:19.447 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:19.447 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:19.448 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:19.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:19.528 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:19.525+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:19.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-07-29T16:39:19.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-07-29T16:39:19.627 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2023-07-29T16:39:19.628 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:39:19.628 INFO:teuthology.orchestra.console.smithi151:Power on 2023-07-29T16:39:19.628 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T16:39:19.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:39:19.647 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:19.641+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:19.670 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-07-29T16:39:19.671 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:39:19.686 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:19.686 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:19.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.479332204999999, 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:19.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.688 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:19.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:19.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:19.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:19.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:19.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:19.698 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.261860331000001, 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:19.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:19.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:19.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.259339918999999, 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.709 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:19.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:19.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:19.718 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.259218173000001, 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:19.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:19.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:19.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.727 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.258976208, 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:19.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:19.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:19.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:19.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.258825953999999, 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.739 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:19.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:19.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.747 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.258703082, 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:19.748 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.749 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:19.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:19.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:19.757 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.258257948000001, 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:19.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:19.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:19.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:19.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:19.767 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.2581718, 2023-07-29T16:39:19.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:19.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:19.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:19.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:19.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:19.776 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.777 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.257171657000001, 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.778 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:19.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.256837844, 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.787 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:19.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.795 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0685359180000003, 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:19.796 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:19.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:19.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:19.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0659708590000001, 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.806 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:19.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:19.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:19.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:19.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:19.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0656703649999999, 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:19.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:19.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:19.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.831 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0508805519999997, 2023-07-29T16:39:19.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.833 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:19.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:19.844 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0499796769999996, 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.845 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:19.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:19.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:19.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:19.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0411299249999999, 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:19.856 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:19.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:19.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:19.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.867 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0410480719999997, 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.868 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:19.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:19.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:19.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:19.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:19.880 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.040136532, 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:19.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:19.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:19.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:19.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:19.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:19.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.0226842630000004, 2023-07-29T16:39:19.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:19.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:19.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:19.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:19.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:19.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:19.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:19.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:19.904 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:19.904 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:19.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:19.907 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-07-29T16:39:19.907 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:19.903+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:20.006 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.003+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:20.076 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:20.076 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:20.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150224 5.0 5:05b0cea7:::benchmark_data_smithi070_97781_object8439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.071781+0000", 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0015886609999999999, 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016147469999999999, 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150224 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071781+0000", 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071781+0000", 2023-07-29T16:39:20.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071780+0000", 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071784+0000", 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6979999999999997e-06 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071794+0000", 2023-07-29T16:39:20.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071803+0000", 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5140000000000007e-06 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.073227+0000", 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001423384 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.073351+0000", 2023-07-29T16:39:20.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124678 2023-07-29T16:39:20.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150226 5.0 5.4ef44900 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.071907+0000", 2023-07-29T16:39:20.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0014627570000000001, 2023-07-29T16:39:20.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015678319999999999, 2023-07-29T16:39:20.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:20.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.089 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150226 2023-07-29T16:39:20.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.089 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071907+0000", 2023-07-29T16:39:20.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071907+0000", 2023-07-29T16:39:20.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071906+0000", 2023-07-29T16:39:20.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071910+0000", 2023-07-29T16:39:20.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.788e-06 2023-07-29T16:39:20.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071918+0000", 2023-07-29T16:39:20.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8119999999999997e-06 2023-07-29T16:39:20.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071926+0000", 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8369999999999997e-06 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:150228 5.9 e53/19 5:9758be72:::benchmark_data_smithi070_97781_object8443:head v 53'9356, mlcod=53'9352)", 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.072683+0000", 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00068649, 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086904599999999995, 2023-07-29T16:39:20.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072683+0000", 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072683+0000", 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072682+0000", 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072688+0000", 2023-07-29T16:39:20.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2820000000000004e-06 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072697+0000", 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5300000000000002e-06 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072703+0000", 2023-07-29T16:39:20.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2609999999999999e-06 2023-07-29T16:39:20.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072743+0000", 2023-07-29T16:39:20.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0141000000000001e-05 2023-07-29T16:39:20.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.072764+0000", 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0795e-05 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150215 5.0 5:01341c35:::benchmark_data_smithi070_97781_object8430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.066959+0000", 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0064103270000000004, 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066641230000000001, 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.106 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150215 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066959+0000", 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066959+0000", 2023-07-29T16:39:20.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066958+0000", 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066963+0000", 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3980000000000001e-06 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066974+0000", 2023-07-29T16:39:20.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1630999999999999e-05 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.066980+0000", 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4770000000000002e-06 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067009+0000", 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9522999999999998e-05 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067107+0000", 2023-07-29T16:39:20.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8097999999999995e-05 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:150210 5.9 e53/19 5:996d6ee1:::benchmark_data_smithi070_97781_object8425:head v 53'9354, mlcod=53'9351)", 2023-07-29T16:39:20.113 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.067262+0000", 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0061070129999999997, 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064345399999999999, 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067262+0000", 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067262+0000", 2023-07-29T16:39:20.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067262+0000", 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067268+0000", 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0159999999999997e-06 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067278+0000", 2023-07-29T16:39:20.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0253e-05 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067286+0000", 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0220000000000004e-06 2023-07-29T16:39:20.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067336+0000", 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0179999999999997e-05 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.067355+0000", 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8944e-05 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.120 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:150214 5.9 e53/19 5:9dba1ec4:::benchmark_data_smithi070_97781_object8429:head v 53'9355, mlcod=53'9351)", 2023-07-29T16:39:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.068807+0000", 2023-07-29T16:39:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0045619579999999996, 2023-07-29T16:39:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049476909999999997, 2023-07-29T16:39:20.121 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068807+0000", 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068807+0000", 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068807+0000", 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068811+0000", 2023-07-29T16:39:20.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4349999999999999e-06 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068819+0000", 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2960000000000001e-06 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.068824+0000", 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6559999999999997e-06 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069150+0000", 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032521699999999999 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069169+0000", 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9439000000000001e-05 2023-07-29T16:39:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150221 5.a 5:5a74b7ae:::benchmark_data_smithi070_97781_object8436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.069614+0000", 2023-07-29T16:39:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0037555650000000002, 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042015630000000002, 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150221 2023-07-29T16:39:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069614+0000", 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069614+0000", 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069613+0000", 2023-07-29T16:39:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069617+0000", 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6890000000000002e-06 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069626+0000", 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8969999999999997e-06 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069632+0000", 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8119999999999996e-06 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069677+0000", 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5269000000000003e-05 2023-07-29T16:39:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069811+0000", 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013378500000000001 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150222 5.b 5:db436414:::benchmark_data_smithi070_97781_object8437:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.069640+0000", 2023-07-29T16:39:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.003728936, 2023-07-29T16:39:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042412190000000001, 2023-07-29T16:39:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150222 2023-07-29T16:39:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069640+0000", 2023-07-29T16:39:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069640+0000", 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069640+0000", 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069642+0000", 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.68e-06 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069647+0000", 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7010000000000001e-06 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069651+0000", 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0699999999999998e-06 2023-07-29T16:39:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069694+0000", 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3047000000000003e-05 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.069837+0000", 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014318999999999999 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:150218 5.f e53/19 5:f6387a83:::benchmark_data_smithi070_97781_object8433:head v 53'9326, mlcod=53'9321)", 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.070077+0000", 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0032921560000000001, 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038743290000000001, 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070077+0000", 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070077+0000", 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070077+0000", 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070080+0000", 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5200000000000002e-06 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070087+0000", 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3890000000000002e-06 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070090+0000", 2023-07-29T16:39:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7919999999999999e-06 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070123+0000", 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2477000000000001e-05 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.070141+0000", 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7669e-05 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:150223 5.0 5:0f8b927d:::benchmark_data_smithi070_97781_object8438:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:20.071206+0000", 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0021635249999999999, 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028064180000000002, 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 150223 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071206+0000", 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071206+0000", 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071205+0000", 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071209+0000", 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1409999999999998e-06 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071218+0000", 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5189999999999992e-06 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071223+0000", 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1630000000000004e-06 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071662+0000", 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043951400000000001 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:20.071758+0000", 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5915000000000006e-05 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2023-07-29T16:39:20.161 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:20.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:20.164 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.160+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.192 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:20.212 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:20.212 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:20.213 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:20.213 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:20.215 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:20.215 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:20.264 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.261+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.339 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:20.340 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:20.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:20.365 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.362+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.466 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.463+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.532 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:20.532 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:20.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:20.567 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:20.565+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:20.625 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:39:20.668 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:20.666+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:20.735 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:20.736 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:20.748 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:20.794 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.789+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:20.870 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:20.868+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:20.924 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:20.925 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:20.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:20.979 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:20.976+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.071 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:21.068+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.166 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:21.167 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:21.172 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:21.169+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:21.272 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:21.269+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.357 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:21.357 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:21.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:21.374 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:21.371+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:21.474 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:21.472+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:21.538 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:21.538 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:21.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:21.576 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:21.573+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.677 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:21.675+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:21.767 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:21.767 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:21.777 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:21.774+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:21.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:21.878 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:21.876+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:21.956 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:21.956 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:21.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:22.014 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:22.011+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:22.087 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:22.079+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:22.157 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:22.157 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:22.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:22.182 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:22.180+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:22.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:22.284 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:22.282+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:22.363 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:22.385 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:22.382+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:22.387 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:22.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:22.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:22.388 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:22.390 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:22.391 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:22.395 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:22.395 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:22.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:22.396 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:22.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.192739767999999, 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.397 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.398 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:22.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:22.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:22.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:22.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:22.409 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.975267894000002, 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:22.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:22.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:22.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:22.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:22.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:22.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:22.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:22.420 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.420 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.972747481999999, 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:22.421 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.422 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:22.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:22.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:22.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:22.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:22.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:22.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:22.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:22.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:22.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.972625736000001, 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.433 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:22.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:22.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:22.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.441 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.972383771000001, 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.442 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:22.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:22.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:22.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:22.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:22.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:22.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.453 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.454 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.454 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:22.454 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.972233516999999, 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.455 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:22.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:22.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:22.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:22.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:22.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.465 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.465 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:22.465 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.972110645000001, 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.466 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:22.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:22.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.475 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.971665511000001, 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:22.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:22.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:22.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:22.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:22.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:22.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:22.487 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.971579363, 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.488 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:22.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:22.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:22.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.970579220000001, 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.497 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:22.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:22.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.970245407, 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:22.507 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.508 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:22.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:22.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:22.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7819434809999999, 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:22.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:22.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:22.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.527 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7793784219999997, 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:22.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:22.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:22.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:22.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7790779279999995, 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:22.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:22.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:22.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7642881150000003, 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.556 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:22.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:22.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:22.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:22.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7633872400000001, 2023-07-29T16:39:22.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.571 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:22.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:22.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7545374880000004, 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:22.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:22.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:22.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.595 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7544556350000002, 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:22.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:22.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:22.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.607 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.7535440949999996, 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.608 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:22.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:22.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:22.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:22.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:22.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:22.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 7.736091826, 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:22.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:22.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:22.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:22.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:22.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:22.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:22.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:22.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:22.633 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:22.634 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:22.635 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:22.636 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:22.633+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:22.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:39:22.753 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:22.733+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:22.799 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:22.799 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157805 5.f e54/19 5:f9768a89:::benchmark_data_smithi070_97781_object16020:head v 54'9798, mlcod=54'9795)", 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.794800+0000", 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0015643650000000001, 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001581299, 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794800+0000", 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794800+0000", 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794800+0000", 2023-07-29T16:39:22.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794803+0000", 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1970000000000001e-06 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794808+0000", 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3970000000000002e-06 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794812+0000", 2023-07-29T16:39:22.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0169999999999998e-06 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794841+0000", 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8568000000000002e-05 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794858+0000", 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6487e-05 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157806 5.f e54/19)", 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.796292+0000", 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.2303000000000002e-05, 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125912, 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796292+0000", 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796292+0000", 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796291+0000", 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796297+0000", 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7429999999999999e-06 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796308+0000", 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1181e-05 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.796315+0000", 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.567e-06 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.811 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:157793 5.a 5:57665a2a:::benchmark_data_smithi070_97781_object16008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.789780+0000", 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0065840209999999998, 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066688909999999997, 2023-07-29T16:39:22.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 157793 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.813 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789780+0000", 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789780+0000", 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789780+0000", 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789783+0000", 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7930000000000002e-06 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789790+0000", 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9639999999999997e-06 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789794+0000", 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9999999999999998e-06 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789824+0000", 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0524000000000001e-05 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.789917+0000", 2023-07-29T16:39:22.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2808999999999999e-05 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157789 5.d e54/51 5:bf04f5b5:::benchmark_data_smithi070_97781_object16004:head v 54'9871, mlcod=54'9867)", 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.790140+0000", 2023-07-29T16:39:22.819 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0062246239999999998, 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063493550000000001, 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790140+0000", 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790140+0000", 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790139+0000", 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790144+0000", 2023-07-29T16:39:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.22e-06 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790155+0000", 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0164e-05 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790161+0000", 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.049e-06 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790205+0000", 2023-07-29T16:39:22.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4793999999999998e-05 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.790228+0000", 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2826000000000001e-05 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:157799 5.8 5:1f14f22a:::benchmark_data_smithi070_97781_object16014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.791464+0000", 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0049008769999999997, 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050650260000000003, 2023-07-29T16:39:22.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 157799 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791464+0000", 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791464+0000", 2023-07-29T16:39:22.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791463+0000", 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791467+0000", 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6509999999999999e-06 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791474+0000", 2023-07-29T16:39:22.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9040000000000003e-06 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791479+0000", 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500000000000003e-06 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791513+0000", 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3967000000000002e-05 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791610+0000", 2023-07-29T16:39:22.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6509999999999996e-05 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157798 5.f e54/19 5:f68a310f:::benchmark_data_smithi070_97781_object16013:head v 54'9797, mlcod=54'9795)", 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.791620+0000", 2023-07-29T16:39:22.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0047445389999999999, 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049485270000000003, 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791620+0000", 2023-07-29T16:39:22.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791620+0000", 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791620+0000", 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791623+0000", 2023-07-29T16:39:22.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1300000000000001e-06 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791628+0000", 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7840000000000003e-06 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791631+0000", 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8800000000000001e-06 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791663+0000", 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1393000000000003e-05 2023-07-29T16:39:22.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.791675+0000", 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2033e-05 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157801 5.d e54/51 5:b1a3484d:::benchmark_data_smithi070_97781_object16016:head v 54'9872, mlcod=54'9868)", 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.793284+0000", 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0030809079999999998, 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033268460000000001, 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.840 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793284+0000", 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793284+0000", 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793283+0000", 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793288+0000", 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5859999999999998e-06 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793295+0000", 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4869999999999996e-06 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793301+0000", 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.767e-06 2023-07-29T16:39:22.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793345+0000", 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.384e-05 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.793368+0000", 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332e-05 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:157803 5.b 5:dc8f1223:::benchmark_data_smithi070_97781_object16018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-07-29T16:39:22.846 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.794399+0000", 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0019654450000000001, 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022505350000000001, 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.847 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 157803 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794399+0000", 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794399+0000", 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794398+0000", 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794401+0000", 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9100000000000001e-06 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794409+0000", 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9910000000000002e-06 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794414+0000", 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.967e-06 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794443+0000", 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8767000000000001e-05 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794532+0000", 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8714000000000005e-05 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:157807 5.4 5:293c9d68:::benchmark_data_smithi070_97781_object16022:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.794638+0000", 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001726057, 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020504159999999998, 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:22.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 157807 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794638+0000", 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794638+0000", 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794638+0000", 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794642+0000", 2023-07-29T16:39:22.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2069999999999997e-06 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794651+0000", 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1079999999999999e-06 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794663+0000", 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1635e-05 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794711+0000", 2023-07-29T16:39:22.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8066999999999999e-05 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794844+0000", 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013288199999999999 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:157804 5.9 e54/19 5:93c4aea8:::benchmark_data_smithi070_97781_object16019:head v 54'9850, mlcod=54'9848)", 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:22.794770+0000", 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0015945219999999999, 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019546519999999999, 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:22.861 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794770+0000", 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794770+0000", 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794770+0000", 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:22.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794774+0000", 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4839999999999998e-06 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794781+0000", 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3749999999999997e-06 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794787+0000", 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5140000000000001e-06 2023-07-29T16:39:22.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794816+0000", 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9132000000000002e-05 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:22.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:22.794833+0000", 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.732e-05 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2023-07-29T16:39:22.867 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:22.869 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:22.869 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:22.867+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:22.969 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:22.967+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:23.070 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:23.071 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:23.071 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:23.071 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:23.071 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:23.072 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.068+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:23.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:23.172 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.169+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:23.272 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.270+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:23.300 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:23.301 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:23.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:23.301 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:23.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.246845480000001, 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:23.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:23.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:23.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:23.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:23.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.24676165, 2023-07-29T16:39:23.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.313 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.244218685, 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:23.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:23.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:23.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.229458639000001, 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:23.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:23.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:23.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:23.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:23.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.201932592999999, 2023-07-29T16:39:23.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.345 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.201772789, 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.355 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:23.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:23.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:23.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:23.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.197645637000001, 2023-07-29T16:39:23.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:23.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:23.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.191998831999999, 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.376 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:23.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:23.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:23.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:23.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:23.386 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.147009538999999, 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:23.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:23.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:23.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.089926632000001, 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:23.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:23.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:23.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:23.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.089852549, 2023-07-29T16:39:23.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.408 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:23.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:23.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.089654134, 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:23.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:23.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:23.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.427 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.089272815000001, 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:23.428 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:23.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:23.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:23.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:23.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.087879692000001, 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:23.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:23.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:23.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.612683864000001, 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:23.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:23.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.052386104, 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.459 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:23.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:23.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:23.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:23.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:23.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:23.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:23.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:23.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:23.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:23.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:23.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:23.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:23.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:23.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:23.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.672732881999998, 2023-07-29T16:39:23.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.475 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:23.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:23.483 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.984179716, 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.484 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:23.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.979285234999999, 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:23.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:23.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:23.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.977617489, 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:23.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:23.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:23.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:23.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:23.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:23.511 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:23.511 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:23.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2023-07-29T16:39:23.512 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.509+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:23.513 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:23.613 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:23.611+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:39:23.701 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:23.701 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:23.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.701 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160485 5.1 5:8b64fc3d:::benchmark_data_smithi070_97781_object18700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.702 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.692364+0000", 2023-07-29T16:39:23.702 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0056502260000000004, 2023-07-29T16:39:23.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056689849999999996, 2023-07-29T16:39:23.702 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.702 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160485 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692364+0000", 2023-07-29T16:39:23.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692364+0000", 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692364+0000", 2023-07-29T16:39:23.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692368+0000", 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4700000000000004e-06 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692376+0000", 2023-07-29T16:39:23.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3920000000000003e-06 2023-07-29T16:39:23.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692383+0000", 2023-07-29T16:39:23.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7399999999999998e-06 2023-07-29T16:39:23.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694347+0000", 2023-07-29T16:39:23.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019640479999999999 2023-07-29T16:39:23.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694458+0000", 2023-07-29T16:39:23.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110703 2023-07-29T16:39:23.712 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.713 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.713 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.714 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160489 5.9 5:97ee6250:::benchmark_data_smithi070_97781_object18704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.714 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.692541+0000", 2023-07-29T16:39:23.714 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0054729590000000003, 2023-07-29T16:39:23.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0055364129999999996, 2023-07-29T16:39:23.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.715 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:23.715 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.716 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.716 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160489 2023-07-29T16:39:23.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.717 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692541+0000", 2023-07-29T16:39:23.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692541+0000", 2023-07-29T16:39:23.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692541+0000", 2023-07-29T16:39:23.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692545+0000", 2023-07-29T16:39:23.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2010000000000001e-06 2023-07-29T16:39:23.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692553+0000", 2023-07-29T16:39:23.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3510000000000002e-06 2023-07-29T16:39:23.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.692560+0000", 2023-07-29T16:39:23.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6479999999999997e-06 2023-07-29T16:39:23.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694566+0000", 2023-07-29T16:39:23.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020057930000000001 2023-07-29T16:39:23.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694681+0000", 2023-07-29T16:39:23.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115587 2023-07-29T16:39:23.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:23.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694788+0000", 2023-07-29T16:39:23.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010714599999999999 2023-07-29T16:39:23.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.729 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.730 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.731 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160490 5.d 5:ba874ad0:::benchmark_data_smithi070_97781_object18705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.731 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.693563+0000", 2023-07-29T16:39:23.731 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0044511730000000001, 2023-07-29T16:39:23.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045575329999999999, 2023-07-29T16:39:23.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.732 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:23.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.732 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.733 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160490 2023-07-29T16:39:23.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.734 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693563+0000", 2023-07-29T16:39:23.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693563+0000", 2023-07-29T16:39:23.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693562+0000", 2023-07-29T16:39:23.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693567+0000", 2023-07-29T16:39:23.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0429999999999998e-06 2023-07-29T16:39:23.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693579+0000", 2023-07-29T16:39:23.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1375999999999999e-05 2023-07-29T16:39:23.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693586+0000", 2023-07-29T16:39:23.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.99e-06 2023-07-29T16:39:23.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696490+0000", 2023-07-29T16:39:23.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029043039999999999 2023-07-29T16:39:23.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696611+0000", 2023-07-29T16:39:23.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012083600000000001 2023-07-29T16:39:23.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:23.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696709+0000", 2023-07-29T16:39:23.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7959000000000002e-05 2023-07-29T16:39:23.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.750 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.751 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.752 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160491 5.f 5:f151b9e6:::benchmark_data_smithi070_97781_object18706:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.752 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.693592+0000", 2023-07-29T16:39:23.753 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0044222439999999997, 2023-07-29T16:39:23.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0045693019999999999, 2023-07-29T16:39:23.753 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.754 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:23.754 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.754 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.755 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.755 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160491 2023-07-29T16:39:23.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.756 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693592+0000", 2023-07-29T16:39:23.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693592+0000", 2023-07-29T16:39:23.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693592+0000", 2023-07-29T16:39:23.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693595+0000", 2023-07-29T16:39:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7769999999999998e-06 2023-07-29T16:39:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693602+0000", 2023-07-29T16:39:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1600000000000001e-06 2023-07-29T16:39:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693607+0000", 2023-07-29T16:39:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8380000000000001e-06 2023-07-29T16:39:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693642+0000", 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5392000000000003e-05 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693762+0000", 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012002000000000001 2023-07-29T16:39:23.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.693865+0000", 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010305 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695652+0000", 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001786812 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160492 5.7 5:ec0833f2:::benchmark_data_smithi070_97781_object18707:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.694741+0000", 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003273331, 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003464291, 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160492 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694741+0000", 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694741+0000", 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694740+0000", 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694746+0000", 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2809999999999999e-06 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694757+0000", 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1516e-05 2023-07-29T16:39:23.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694765+0000", 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2630000000000003e-06 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694804+0000", 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8439000000000002e-05 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.694916+0000", 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011197900000000001 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.826 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160493 5.9 5:905745a9:::benchmark_data_smithi070_97781_object18708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.695280+0000", 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0027339579999999999, 2023-07-29T16:39:23.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029621700000000001, 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160493 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.828 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695280+0000", 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695280+0000", 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695280+0000", 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695285+0000", 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3759999999999999e-06 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695295+0000", 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9469999999999998e-06 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695309+0000", 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3871e-05 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696307+0000", 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00099845800000000003 2023-07-29T16:39:23.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696415+0000", 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010794900000000001 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696522+0000", 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010661400000000001 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160494 5.7 5:e5c83889:::benchmark_data_smithi070_97781_object18709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.695955+0000", 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0020591709999999998, 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002333781, 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.836 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160494 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695955+0000", 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695955+0000", 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695954+0000", 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695959+0000", 2023-07-29T16:39:23.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2590000000000002e-06 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695967+0000", 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7260000000000008e-06 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.695974+0000", 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3849999999999999e-06 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696753+0000", 2023-07-29T16:39:23.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00077909500000000005 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696882+0000", 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000128577 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:160489 5.9 e55/19)", 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696441+0000", 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0015733640000000001, 2023-07-29T16:39:23.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019089179999999999, 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696441+0000", 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696441+0000", 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696441+0000", 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696445+0000", 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3760000000000001e-06 2023-07-29T16:39:23.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696453+0000", 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6260000000000003e-06 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696459+0000", 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5390000000000004e-06 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.848 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160495 5.f 5.5a5d7b4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696702+0000", 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0013128809999999999, 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001696548, 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160495 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696702+0000", 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696702+0000", 2023-07-29T16:39:23.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696701+0000", 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696705+0000", 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5970000000000002e-06 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696714+0000", 2023-07-29T16:39:23.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0089999999999996e-06 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696723+0000", 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1489999999999994e-06 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.854 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160496 5.3 5:cefe4746:::benchmark_data_smithi070_97781_object18711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696731+0000", 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001283041, 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017269640000000001, 2023-07-29T16:39:23.855 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160496 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.856 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696731+0000", 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696731+0000", 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696731+0000", 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696734+0000", 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8739999999999999e-06 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696740+0000", 2023-07-29T16:39:23.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9499999999999998e-06 2023-07-29T16:39:23.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696745+0000", 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0409999999999997e-06 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697046+0000", 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000301465 2023-07-29T16:39:23.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697154+0000", 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107446 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160497 5.5 5:abcef1fa:::benchmark_data_smithi070_97781_object18712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696756+0000", 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001258779, 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017449010000000001, 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.863 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160497 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696756+0000", 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696756+0000", 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696755+0000", 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696758+0000", 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4719999999999998e-06 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696764+0000", 2023-07-29T16:39:23.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7740000000000001e-06 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696769+0000", 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1499999999999998e-06 2023-07-29T16:39:23.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696863+0000", 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4618999999999997e-05 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696947+0000", 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4058000000000001e-05 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.870 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160499 5.f 5.b2549bef (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696780+0000", 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0012347269999999999, 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001788017, 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.871 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160499 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696780+0000", 2023-07-29T16:39:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696780+0000", 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696779+0000", 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696782+0000", 2023-07-29T16:39:23.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7190000000000001e-06 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696789+0000", 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2690000000000002e-06 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696794+0000", 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2480000000000004e-06 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.876 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160500 5.7 5.a8a7ca77 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.696902+0000", 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0011128869999999999, 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001723331, 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.877 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160500 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696902+0000", 2023-07-29T16:39:23.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696902+0000", 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696901+0000", 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696906+0000", 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5809999999999996e-06 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696916+0000", 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0266e-05 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.696924+0000", 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8259999999999993e-06 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:160493 5.9 e55/19 ondisk, result = 0)", 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.697984+0000", 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.0676000000000002e-05, 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00069286599999999999, 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.883 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697984+0000", 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697984+0000", 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697983+0000", 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:23.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697988+0000", 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6120000000000001e-06 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.697997+0000", 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0869999999999996e-06 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.698004+0000", 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.199e-06 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.698616+0000", 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000612639 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.698620+0000", 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9929999999999997e-06 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:160478 5.7 5:ed7ff18f:::benchmark_data_smithi070_97781_object18693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:23.689491+0000", 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0085239159999999994, 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092646010000000008, 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:23.890 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 160478 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689491+0000", 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689491+0000", 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:23.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689490+0000", 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689493+0000", 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.446e-06 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689499+0000", 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2589999999999997e-06 2023-07-29T16:39:23.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.689504+0000", 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7960000000000003e-06 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:23.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.691316+0000", 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018124790000000001 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.691449+0000", 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000132791 2023-07-29T16:39:23.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:23.698748+0000", 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0072992789999999997 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:23.898 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:23.898 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 15 2023-07-29T16:39:23.898 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:23.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:23.900 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.896+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:23.908 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:39:23.999 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:23.997+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:24.021 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:39:24.100 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:24.098+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:24.118 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:24.119 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:24.119 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:24.119 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:24.119 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:24.123 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-07-29T16:39:24.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:24.202 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:24.199+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:24.224 DEBUG:teuthology.orchestra.console.smithi151:Waiting for login prompt 2023-07-29T16:39:24.225 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi151 2023-07-29T16:39:24.303 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:24.301+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:24.373 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:24.373 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 32.171096710999997, 2023-07-29T16:39:24.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:24.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:24.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:24.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:24.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:24.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:24.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:24.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:24.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:24.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:24.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:24.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:24.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:24.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:24.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:24.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:24.390 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.392 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.392 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.393 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:24.393 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.953624837, 2023-07-29T16:39:24.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:24.394 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.394 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.394 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.394 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.395 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.395 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:24.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.396 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:24.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:24.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:24.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:24.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:24.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:24.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:24.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:24.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:24.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:24.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:24.409 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.410 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.410 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.410 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.951104425, 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.411 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:24.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:24.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:24.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:24.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:24.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:24.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:24.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:24.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:24.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:24.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:24.423 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.424 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.424 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.950982678999999, 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:24.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:24.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:24.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:24.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:24.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:24.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:24.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:24.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:24.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:24.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:24.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:24.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:24.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:24.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:24.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:24.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:24.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:24.440 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.440 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.440 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.950740713999998, 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:24.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:24.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:24.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:24.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:24.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:24.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:24.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:24.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:24.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:24.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:24.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:24.454 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.455 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.456 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.456 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:24.456 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.950590460000001, 2023-07-29T16:39:24.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:24.457 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.457 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.458 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.458 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.458 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.458 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:24.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.459 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:24.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:24.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:24.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:24.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:24.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:24.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:24.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.469 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.950467587999999, 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.470 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.471 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.471 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:24.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.471 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:24.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:24.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:24.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:24.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:24.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:24.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:24.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:24.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:24.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:24.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:24.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:24.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.484 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.950022453999999, 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.485 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:24.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:24.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:24.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:24.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.493 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.949936306000001, 2023-07-29T16:39:24.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.495 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:24.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:24.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:24.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:24.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.948936162999999, 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:24.505 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:24.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:24.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:24.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:24.513 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.948602350000002, 2023-07-29T16:39:24.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:24.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:24.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:24.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7603004240000004, 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.524 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:24.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:24.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:24.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.533 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7577353650000003, 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.534 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:24.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:24.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7574348709999992, 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.547 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:24.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:24.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:24.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:24.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:24.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7426450580000008, 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:24.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:24.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:24.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.571 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7417441829999998, 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.572 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:24.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:24.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:24.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:24.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:24.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:24.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7328944310000001, 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:24.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.585 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:24.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:24.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7328125780000008, 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:24.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:24.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:24.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:24.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7319010380000002, 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:24.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:24.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:24.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:24.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 9.7144487690000005, 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:24.620 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:24.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:24.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:24.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:24.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:24.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:24.631 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:24.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:24.634 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:24.632+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:24.635 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:24.734 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:24.732+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:24.782 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:24.802 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:24.802 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:24.802 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:24.803 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:24.805 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:24.805 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:24.809 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:24.809 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:24.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:24.835 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:24.832+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:24.936 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:24.933+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:24.995 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:24.995 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:25.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:25.055 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:25.053+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:25.138 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:25.135+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:25.185 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:25.186 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:25.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:25.243 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:25.241+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:25.340 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:25.337+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:25.373 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:25.374 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:25.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:25.441 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:25.439+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:25.541 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:25.539+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:25.604 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:25.605 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:25.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:25.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:39:25.642 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:25.640+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:25.743 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:25.741+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:25.843 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:25.841+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:25.849 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:25.849 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:25.863 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:25.944 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:25.942+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.014 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:26.015 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:26.028 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:26.074 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:26.072+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:26.145 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:26.143+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.198 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:26.198 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:26.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:26.246 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:26.244+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.348 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:26.346+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:26.427 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:26.427 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:26.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:26.482 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:26.480+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:26.551 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:26.547+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.628 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:26.628 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:26.629 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:39:26.645 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:26.650 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:26.648+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:26.751 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:26.749+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:26.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:26.852 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:26.849+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.868 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:26.868 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:26.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:26.954 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:26.967 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:26.964+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:26.975 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:26.978 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:26.979 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:27.053 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:27.050+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:27.112 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:27.113 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:27.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:27.113 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:27.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.113 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.910950749999998, 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.114 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:27.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:27.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:27.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:27.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:27.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:27.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:27.125 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.693478876, 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.126 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:27.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.127 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:27.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:27.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.136 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.690958464000001, 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.137 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:27.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:27.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:27.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:27.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.146 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.147 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.147 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:27.147 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.690836718, 2023-07-29T16:39:27.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:27.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:27.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:27.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.690594752999999, 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:27.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:27.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:27.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:27.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.690444499000002, 2023-07-29T16:39:27.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:27.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:27.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:27.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.690321626999999, 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:27.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:27.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:27.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:27.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.689876493, 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:27.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:27.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:27.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:27.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:27.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:27.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:27.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:27.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:27.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:27.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:27.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.689790344999999, 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.200 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:27.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:27.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:27.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:27.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.688790202, 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:27.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:27.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.218 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.220 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:27.220 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:27.220 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.688456388999999, 2023-07-29T16:39:27.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:27.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.222 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.222 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.222 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:27.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.223 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:27.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:27.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:27.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:27.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:27.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:27.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:27.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:27.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.232 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:27.233 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.500154462999999, 2023-07-29T16:39:27.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:27.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:27.234 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.234 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.234 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.234 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:27.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.235 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:27.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:27.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:27.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:27.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:27.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:27.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:27.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:27.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:27.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:27.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:27.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:27.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:27.245 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.497589403999999, 2023-07-29T16:39:27.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:27.247 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.247 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.247 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:27.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:27.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:27.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:27.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:27.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:27.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.260 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.49728891, 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.261 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:27.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:27.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:27.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:27.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:27.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:27.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:27.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:27.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:27.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:27.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:27.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:27.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:27.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:27.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:27.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:27.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:27.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:27.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:27.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:27.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:27.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:27.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:27.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:27.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:27.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:27.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:27.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:27.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:27.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:27.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:27.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:27.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.284 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.284 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:27.285 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.482499097, 2023-07-29T16:39:27.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:27.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:27.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:27.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:27.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:27.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:27.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:27.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:27.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:27.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.297 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:27.298 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.481598222000001, 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:27.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:27.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:27.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:27.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:27.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:27.310 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.310 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.311 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.312 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:27.312 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.472748469999999, 2023-07-29T16:39:27.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:27.313 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.314 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:27.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.314 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:27.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:27.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:27.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:27.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:27.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:27.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:27.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.327 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.472666617, 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.328 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:27.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:27.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:27.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:27.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:27.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.471755076999999, 2023-07-29T16:39:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:27.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.344 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:27.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:27.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:27.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:27.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:27.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:27.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:27.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:27.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:27.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:27.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.357 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.358 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:27.358 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.454302808, 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:27.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:27.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:27.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:27.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:27.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:27.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:27.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:27.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:27.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:27.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:27.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:27.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:27.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:27.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:27.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.372 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.372 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.372 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:27.372 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:27.372 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:27.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:27.375 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:27.371+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:27.475 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:27.472+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:27.548 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:27.548 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:171566 5.0 5:008dcde2:::benchmark_data_smithi070_97781_object29781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.539922+0000", 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0060429330000000003, 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006077608, 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.549 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 171566 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539922+0000", 2023-07-29T16:39:27.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539922+0000", 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539922+0000", 2023-07-29T16:39:27.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539925+0000", 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1590000000000002e-06 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539932+0000", 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2989999999999999e-06 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539939+0000", 2023-07-29T16:39:27.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8589999999999999e-06 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.539974+0000", 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4878e-05 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.540098+0000", 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012412400000000001 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.556 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:171561 5.f e56/19 5:f8bf4ba7:::benchmark_data_smithi070_97781_object29776:head v 56'10669, mlcod=56'10666)", 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.541202+0000", 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004763789, 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048798829999999998, 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541202+0000", 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541202+0000", 2023-07-29T16:39:27.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541201+0000", 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541207+0000", 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7899999999999996e-06 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541215+0000", 2023-07-29T16:39:27.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3219999999999993e-06 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541221+0000", 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2099999999999998e-06 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541271+0000", 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9908999999999999e-05 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541290+0000", 2023-07-29T16:39:27.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.878e-05 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:171569 5.8 5:1dc26228:::benchmark_data_smithi070_97781_object29784:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:27.563 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.541937+0000", 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0040280869999999996, 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062289999999997, 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.564 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 171569 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541937+0000", 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541937+0000", 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541937+0000", 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541940+0000", 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7670000000000001e-06 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541948+0000", 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1250000000000004e-06 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541953+0000", 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0549999999999999e-06 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.541979+0000", 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6007999999999999e-05 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.542064+0000", 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5724999999999997e-05 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:171577 5.4 5:2a1ea612:::benchmark_data_smithi070_97781_object29792:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.544035+0000", 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0019306130000000001, 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002177029, 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.571 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 171577 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544035+0000", 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544035+0000", 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544034+0000", 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544038+0000", 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8890000000000004e-06 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544047+0000", 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:27.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544053+0000", 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7819999999999999e-06 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544095+0000", 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.544228+0000", 2023-07-29T16:39:27.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132719 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:171579 5.0 5:0467b8b9:::benchmark_data_smithi070_97781_object29794:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:27.578 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.545090+0000", 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00087567600000000004, 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001190478, 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 171579 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545090+0000", 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545090+0000", 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545089+0000", 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545094+0000", 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.605e-06 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545106+0000", 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.204e-05 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545112+0000", 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1399999999999997e-06 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545144+0000", 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1835999999999998e-05 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.545228+0000", 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4398000000000001e-05 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:171582 5.4 5:20cf3a33:::benchmark_data_smithi070_97781_object29797:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.546019+0000", 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9999461, 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033118600000000002, 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:27.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 171582 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546019+0000", 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546019+0000", 2023-07-29T16:39:27.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546018+0000", 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546022+0000", 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4359999999999998e-06 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546031+0000", 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5259999999999999e-06 2023-07-29T16:39:27.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546039+0000", 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7230000000000004e-06 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546070+0000", 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0617000000000002e-05 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546151+0000", 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1777e-05 2023-07-29T16:39:27.592 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:171581 5.f e56/19)", 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:27.546277+0000", 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9996886, 2023-07-29T16:39:27.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013347000000000001, 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546277+0000", 2023-07-29T16:39:27.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546277+0000", 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546276+0000", 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546284+0000", 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8210000000000002e-06 2023-07-29T16:39:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546294+0000", 2023-07-29T16:39:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0112000000000001e-05 2023-07-29T16:39:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:27.546301+0000", 2023-07-29T16:39:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2489999999999998e-06 2023-07-29T16:39:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:39:27.599 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:27.601 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:27.602 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:27.598+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:27.701 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:27.698+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:27.804 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:27.801+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:27.817 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:27.817 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:27.817 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:27.817 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:27.817 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:27.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:27.903 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:27.900+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:28.004 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:28.001+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:28.047 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:28.047 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:28.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:28.047 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:28.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.991092332000001, 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:28.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:28.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:28.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:28.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:28.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:28.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.059 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.991008502, 2023-07-29T16:39:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.061 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:28.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.988465537000003, 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:28.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:28.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:28.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:28.081 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.973705490999997, 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.082 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:28.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:28.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:28.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.946179444999999, 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:28.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:28.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:28.103 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.946019640999999, 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:28.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:28.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:28.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:28.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:28.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:28.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:28.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:28.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:28.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:28.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:28.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:28.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:28.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:28.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:28.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:28.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:28.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:28.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.126 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.126 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.127 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:28.127 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.941892488999997, 2023-07-29T16:39:28.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:28.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.128 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:28.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.130 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:28.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:28.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:28.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:28.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:28.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:28.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:28.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:28.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:28.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.936245683999999, 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:28.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:28.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:28.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:28.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.891256390999999, 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:28.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:28.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:28.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.834173483999997, 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:28.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:28.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:28.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:28.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:28.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.834099401000003, 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:28.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:28.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:28.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:28.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:28.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.186 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.833900986000003, 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:28.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:28.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.833519666999997, 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:28.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:28.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:28.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:28.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:28.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:28.207 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.832126543999998, 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:28.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:28.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.356930716000001, 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:28.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:28.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.226 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.796632956, 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:28.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:28.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:28.236 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.416979734000002, 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:28.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:28.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:28.245 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.728426568, 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.246 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:28.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.254 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.723532086999999, 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:28.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:28.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:28.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.721864341, 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:28.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:28.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:28.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:28.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:28.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:28.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:28.272 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:28.273 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:28.274 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:28.274 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:28.271+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:28.375 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:28.372+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:28.456 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:28.457 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:28.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.458 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174223 5.c 5:3ba04826:::benchmark_data_smithi070_97781_object32438:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.458 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.444358+0000", 2023-07-29T16:39:28.458 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0082588569999999997, 2023-07-29T16:39:28.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0082840559999999997, 2023-07-29T16:39:28.459 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.459 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.459 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.460 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.460 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174223 2023-07-29T16:39:28.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.461 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444358+0000", 2023-07-29T16:39:28.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444358+0000", 2023-07-29T16:39:28.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444357+0000", 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444360+0000", 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4849999999999999e-06 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444366+0000", 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8980000000000001e-06 2023-07-29T16:39:28.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444370+0000", 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8250000000000004e-06 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444620+0000", 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00024945700000000002 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444760+0000", 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000140171 2023-07-29T16:39:28.467 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174224 5.7 5:ef18dbdd:::benchmark_data_smithi070_97781_object32439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.444728+0000", 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0078887420000000007, 2023-07-29T16:39:28.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079911749999999997, 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174224 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.469 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444728+0000", 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444728+0000", 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444727+0000", 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444732+0000", 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1340000000000003e-06 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444741+0000", 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7309999999999999e-06 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444748+0000", 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8789999999999997e-06 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444825+0000", 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7214999999999998e-05 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444951+0000", 2023-07-29T16:39:28.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012584299999999999 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174228 5.7 5:e1922060:::benchmark_data_smithi070_97781_object32443:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.444912+0000", 2023-07-29T16:39:28.475 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0077048450000000001, 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078733880000000003, 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.476 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174228 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444912+0000", 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444912+0000", 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444911+0000", 2023-07-29T16:39:28.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444916+0000", 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1030000000000001e-06 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444925+0000", 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8310000000000007e-06 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.444931+0000", 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5350000000000001e-06 2023-07-29T16:39:28.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446709+0000", 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0017779600000000001 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446838+0000", 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000128746 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174231 5.5 5:a59c7be2:::benchmark_data_smithi070_97781_object32446:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.482 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.446556+0000", 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0060602140000000004, 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062935480000000004, 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.483 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174231 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446556+0000", 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446556+0000", 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446556+0000", 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446559+0000", 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9919999999999999e-06 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446565+0000", 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1959999999999996e-06 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446570+0000", 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5990000000000001e-06 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446604+0000", 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3213000000000002e-05 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446702+0000", 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8152999999999994e-05 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174232 5.5 5:ae5fa506:::benchmark_data_smithi070_97781_object32447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.446603+0000", 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.006013549, 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0063130390000000003, 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.490 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174232 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446603+0000", 2023-07-29T16:39:28.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446603+0000", 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446602+0000", 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446605+0000", 2023-07-29T16:39:28.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1370000000000002e-06 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446612+0000", 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0269999999999998e-06 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446618+0000", 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.468e-06 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448000+0000", 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00138255 2023-07-29T16:39:28.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448077+0000", 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6433999999999994e-05 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174233 5.f 5:f976eee3:::benchmark_data_smithi070_97781_object32448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.446821+0000", 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.005795461, 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0061638309999999998, 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:28.497 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174233 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446821+0000", 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446821+0000", 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446820+0000", 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446825+0000", 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2599999999999996e-06 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446835+0000", 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.8479999999999996e-06 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446843+0000", 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4680000000000003e-06 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448364+0000", 2023-07-29T16:39:28.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015214650000000001 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448484+0000", 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000120024 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448592+0000", 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107423 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174234 5.f 5:f0dc423a:::benchmark_data_smithi070_97781_object32449:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.446850+0000", 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0057660890000000003, 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062115870000000002, 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.505 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174234 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446850+0000", 2023-07-29T16:39:28.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446850+0000", 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446850+0000", 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446853+0000", 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.785e-06 2023-07-29T16:39:28.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446860+0000", 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6040000000000004e-06 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.446866+0000", 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9880000000000001e-06 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450331+0000", 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003464333 2023-07-29T16:39:28.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450454+0000", 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122958 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:28.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450565+0000", 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111458 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174235 5.7 5:e0a372b9:::benchmark_data_smithi070_97781_object32450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.512 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.447071+0000", 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0055453569999999999, 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0060721129999999996, 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.513 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174235 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447071+0000", 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447071+0000", 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447070+0000", 2023-07-29T16:39:28.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447075+0000", 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447088+0000", 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2758999999999999e-05 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.447095+0000", 2023-07-29T16:39:28.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8229999999999995e-06 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450316+0000", 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032209439999999999 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450392+0000", 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5425000000000004e-05 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.519 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174238 5.f 5:fa08a5d8:::benchmark_data_smithi070_97781_object32453:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.448272+0000", 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0043443429999999996, 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049354250000000002, 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.520 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174238 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448272+0000", 2023-07-29T16:39:28.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448272+0000", 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448271+0000", 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448276+0000", 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7709999999999997e-06 2023-07-29T16:39:28.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448287+0000", 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0913999999999999e-05 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.448294+0000", 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3479999999999998e-06 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452330+0000", 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0040361240000000003 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452455+0000", 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012421399999999999 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452559+0000", 2023-07-29T16:39:28.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000104392 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174240 5.d 5:bf23d1e1:::benchmark_data_smithi070_97781_object32455:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.527 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.449450+0000", 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0031667150000000001, 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038347870000000001, 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.528 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174240 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449450+0000", 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449450+0000", 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449449+0000", 2023-07-29T16:39:28.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449454+0000", 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0710000000000002e-06 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449467+0000", 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3497e-05 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449475+0000", 2023-07-29T16:39:28.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9910000000000002e-06 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449521+0000", 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5531999999999997e-05 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449653+0000", 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000132299 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449738+0000", 2023-07-29T16:39:28.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4645e-05 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174241 5.c 5:35044321:::benchmark_data_smithi070_97781_object32456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.449586+0000", 2023-07-29T16:39:28.535 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0030306679999999998, 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003789471, 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174241 2023-07-29T16:39:28.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449586+0000", 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449586+0000", 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449585+0000", 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449589+0000", 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4410000000000003e-06 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449601+0000", 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1573000000000001e-05 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449608+0000", 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1269999999999997e-06 2023-07-29T16:39:28.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450134+0000", 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00052636200000000005 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450304+0000", 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000169202 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174242 5.5 5:acf2a8f9:::benchmark_data_smithi070_97781_object32457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.542 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.449703+0000", 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0029128629999999999, 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.003756784, 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.543 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174242 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449703+0000", 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449703+0000", 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449703+0000", 2023-07-29T16:39:28.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449707+0000", 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5190000000000003e-06 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449716+0000", 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1400000000000006e-06 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449723+0000", 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6719999999999998e-06 2023-07-29T16:39:28.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449755+0000", 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2422000000000002e-05 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.449872+0000", 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116904 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.549 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174243 5.d 5:bbf5fe69:::benchmark_data_smithi070_97781_object32458:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.450406+0000", 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0022106270000000002, 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031345829999999998, 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.550 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174243 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450406+0000", 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450406+0000", 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450405+0000", 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450410+0000", 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.237e-06 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450420+0000", 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4399999999999994e-06 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450427+0000", 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6820000000000003e-06 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.451625+0000", 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00119787 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.451700+0000", 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4647000000000005e-05 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.451761+0000", 2023-07-29T16:39:28.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1587000000000005e-05 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174245 5.2 5:4c9f899c:::benchmark_data_smithi070_97781_object32460:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.450975+0000", 2023-07-29T16:39:28.557 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0016415550000000001, 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002651161, 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174245 2023-07-29T16:39:28.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450975+0000", 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450975+0000", 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450974+0000", 2023-07-29T16:39:28.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450979+0000", 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4209999999999997e-06 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450988+0000", 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7389999999999994e-06 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.450996+0000", 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.413e-06 2023-07-29T16:39:28.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.451035+0000", 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9801000000000001e-05 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.451151+0000", 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115835 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_repop_reply(client.4749.0:174233 5.f e56/19)", 2023-07-29T16:39:28.564 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.452119+0000", 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00049754499999999995, 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015823530000000001, 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452119+0000", 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452119+0000", 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452118+0000", 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452123+0000", 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.967e-06 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452135+0000", 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1623999999999999e-05 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.452141+0000", 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174246 5.3 5:c96b9612:::benchmark_data_smithi070_97781_object32461:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.453190+0000", 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9994259, 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00056803599999999995, 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.570 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174246 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453190+0000", 2023-07-29T16:39:28.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453190+0000", 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453189+0000", 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453194+0000", 2023-07-29T16:39:28.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2939999999999996e-06 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453206+0000", 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453215+0000", 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5779999999999999e-06 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453257+0000", 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2710000000000003e-05 2023-07-29T16:39:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453347+0000", 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9876999999999993e-05 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174247 5.6 5:6466c49c:::benchmark_data_smithi070_97781_object32462:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.453228+0000", 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9993887, 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00059881099999999998, 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174247 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453228+0000", 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453228+0000", 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453227+0000", 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453230+0000", 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.441e-06 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453237+0000", 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2470000000000002e-06 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453242+0000", 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8790000000000002e-06 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453284+0000", 2023-07-29T16:39:28.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1844999999999997e-05 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453423+0000", 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013932500000000001 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:174250 5.2 5:4ff49c4c:::benchmark_data_smithi070_97781_object32465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:28.453583+0000", 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.999033, 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000283789, 2023-07-29T16:39:28.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 174250 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:28.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453583+0000", 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453583+0000", 2023-07-29T16:39:28.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453582+0000", 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453587+0000", 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3549999999999998e-06 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453596+0000", 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.8349999999999993e-06 2023-07-29T16:39:28.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453602+0000", 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9909999999999999e-06 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:28.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453642+0000", 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0102999999999999e-05 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:28.453755+0000", 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011296800000000001 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.590 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:28.591 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 18 2023-07-29T16:39:28.591 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:28.592 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:28.589+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:28.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:28.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:39:28.693 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:28.690+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:28.777 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:28.777 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:28.778 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:28.778 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:28.778 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:28.793 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:29.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:29.123 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.120+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.223 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.220+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:29.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:29.296 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:29.296 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:29.296 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:29.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:29.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:29.305 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:29.305 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:29.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:29.362 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.359+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.427 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:29.423+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:29.503 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:29.503 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:29.517 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:29.526 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.523+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.626 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.624+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.640 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:39:29.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~36s 2023-07-29T16:39:29.727 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:29.724+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:29.730 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:29.730 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:29.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:29.829 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:29.826+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:29.929 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:29.927+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:29.954 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:29.954 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:29.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:30.031 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.028+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.133 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:30.128+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:30.149 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:30.149 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:30.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:30.248 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.245+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.334 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.331+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.370 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:30.370 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:30.386 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:30.436 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:30.433+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:30.537 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.535+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.610 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:30.610 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:30.623 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:30.665 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.662+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.740 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.737+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.795 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:30.796 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:30.809 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:30.853 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:30.850+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:30.942 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:30.939+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:30.975 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:30.975 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:30.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:31.043 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:31.040+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:31.144 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:31.141+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:31.197 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:31.197 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:31.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:31.245 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:31.242+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:31.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:31.346 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:31.343+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:31.391 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:31.392 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:31.406 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:31.447 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:31.450 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:31.447+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:31.470 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:31.473 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:31.474 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:31.549 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:31.545+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:31.587 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:31.587 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:31.587 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:31.588 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:31.588 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:31.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:31.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:39:31.686 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:31.683+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:31.750 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:31.747+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:31.822 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:31.823 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:31.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:31.823 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:31.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:31.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:31.825 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.620304673, 2023-07-29T16:39:31.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:31.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.826 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:31.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.827 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:31.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:31.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:31.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:31.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:31.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:31.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:31.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:31.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:31.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:31.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:31.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:31.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:31.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.402832799000002, 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.843 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:31.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.400312387, 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:31.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:31.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:31.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:31.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.864 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:31.865 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.400190641000002, 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:31.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:31.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:31.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.399948676000001, 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.875 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:31.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:31.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:31.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:31.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.886 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.399798422000003, 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:31.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:31.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.897 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.399675549999998, 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.898 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:31.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.399230416000002, 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.907 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.908 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:31.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:31.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:31.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:31.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:31.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.917 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.399144268000001, 2023-07-29T16:39:31.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.919 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:31.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:31.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.398144125000002, 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:31.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:31.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:31.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:31.937 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.397810311999997, 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.938 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:31.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:31.947 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:31.948 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.209508386, 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:31.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:31.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:31.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:31.958 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.206943327000001, 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:31.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:31.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:31.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:31.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:31.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:31.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.206642833, 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.974 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:31.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:31.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:31.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:31.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:31.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.986 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:31.987 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.19185302, 2023-07-29T16:39:31.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:31.988 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:31.988 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:31.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:31.988 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.190952145000001, 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.182102393000001, 2023-07-29T16:39:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.18202054, 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.181108999999999, 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:32.041 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:32.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:32.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:32.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:32.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:32.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:32.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:32.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:32.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 17.163656731, 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:32.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:32.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:32.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:32.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:32.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:32.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:32.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.066 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.067 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.067 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:32.067 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:32.067 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:32.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:32.069 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.065+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.169 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.166+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.242 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:32.243 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:32.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:185139 5.0 5:0038d7de:::benchmark_data_smithi070_97781_object43354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-07-29T16:39:32.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:32.237230+0000", 2023-07-29T16:39:32.244 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0035297919999999999, 2023-07-29T16:39:32.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035570279999999998, 2023-07-29T16:39:32.244 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:32.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 185139 2023-07-29T16:39:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.245 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237230+0000", 2023-07-29T16:39:32.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237230+0000", 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237229+0000", 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237234+0000", 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7339999999999999e-06 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237246+0000", 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1776e-05 2023-07-29T16:39:32.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237252+0000", 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1199999999999999e-06 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237282+0000", 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9935000000000001e-05 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237360+0000", 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8256000000000004e-05 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.251 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:185142 5.d e57/51 5:b3f88339:::benchmark_data_smithi070_97781_object43357:head v 57'11557, mlcod=57'11555)", 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:32.237637+0000", 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0031223169999999999, 2023-07-29T16:39:32.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032143710000000002, 2023-07-29T16:39:32.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:32.254 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237637+0000", 2023-07-29T16:39:32.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237637+0000", 2023-07-29T16:39:32.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237637+0000", 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237641+0000", 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6839999999999998e-06 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237647+0000", 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9110000000000004e-06 2023-07-29T16:39:32.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237651+0000", 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0489999999999997e-06 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237687+0000", 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5788999999999999e-05 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.237708+0000", 2023-07-29T16:39:32.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0253000000000001e-05 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:185141 5.9 e57/19 5:9022a9b9:::benchmark_data_smithi070_97781_object43356:head v 57'11588, mlcod=57'11585)", 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:32.239713+0000", 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0010467919999999999, 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00117274, 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:32.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239713+0000", 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239713+0000", 2023-07-29T16:39:32.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239712+0000", 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239717+0000", 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.481e-06 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239726+0000", 2023-07-29T16:39:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8559999999999996e-06 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239731+0000", 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0989999999999998e-06 2023-07-29T16:39:32.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239759+0000", 2023-07-29T16:39:32.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8521e-05 2023-07-29T16:39:32.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.239773+0000", 2023-07-29T16:39:32.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3414999999999999e-05 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:185144 5.f e57/19 5:f9cf2eb1:::benchmark_data_smithi070_97781_object43359:head v 57'11522, mlcod=57'11520)", 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:32.240250+0000", 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00050951900000000005, 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066790199999999995, 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:32.271 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240250+0000", 2023-07-29T16:39:32.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240250+0000", 2023-07-29T16:39:32.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240249+0000", 2023-07-29T16:39:32.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240255+0000", 2023-07-29T16:39:32.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4890000000000003e-06 2023-07-29T16:39:32.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240265+0000", 2023-07-29T16:39:32.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9520000000000006e-06 2023-07-29T16:39:32.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240271+0000", 2023-07-29T16:39:32.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2650000000000002e-06 2023-07-29T16:39:32.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240299+0000", 2023-07-29T16:39:32.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7423000000000002e-05 2023-07-29T16:39:32.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:32.240311+0000", 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2532e-05 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.283 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:32.284 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 4 2023-07-29T16:39:32.284 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:32.285 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:32.282+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:32.286 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:32.390 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.383+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.491 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.485+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.495 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:32.496 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:32.496 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:32.496 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:32.496 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:32.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:32.607 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.603+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.647 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:39:32.690 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.687+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:32.731 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:32.732 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:32.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:32.732 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:32.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:32.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.676197600000002, 2023-07-29T16:39:32.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:32.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:32.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:32.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:32.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:32.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:32.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:32.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:32.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:32.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:32.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:32.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.748 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:32.750 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.676113770000001, 2023-07-29T16:39:32.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:32.750 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:32.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:32.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:32.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:32.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:32.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:32.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:32.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.762 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.673570804999997, 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.763 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:32.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:32.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:32.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.658810758999998, 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:32.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:32.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:32.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:32.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.785 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.631284712999999, 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:32.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:32.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:32.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:32.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:32.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.797 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.631124909, 2023-07-29T16:39:32.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:32.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.626997756999998, 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:32.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:32.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:32.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.621350952, 2023-07-29T16:39:32.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:32.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:32.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:32.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.576361659, 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:32.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:32.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:32.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.519278751999998, 2023-07-29T16:39:32.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.841 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:32.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:32.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.519204668999997, 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.851 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:32.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.519006253999997, 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.518624934999998, 2023-07-29T16:39:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.517231811999999, 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.042035984000002, 2023-07-29T16:39:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.481738224000001, 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.102085001999999, 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.413531836000001, 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.408637355, 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.406969609000001, 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:32.948 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:32.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:32.949 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:32.793+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:32.953 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:32.949+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:33.050 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:33.048+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:33.146 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:33.146 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:33.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.146 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187669 5.f 5:f32ca151:::benchmark_data_smithi070_97781_object45884:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.124043+0000", 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0059458369999999998, 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0059705870000000003, 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.147 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187669 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124043+0000", 2023-07-29T16:39:33.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124043+0000", 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124042+0000", 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124044+0000", 2023-07-29T16:39:33.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7179999999999999e-06 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124050+0000", 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2700000000000001e-06 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124053+0000", 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.061e-06 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124081+0000", 2023-07-29T16:39:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7960999999999999e-05 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124165+0000", 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4075999999999999e-05 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.124230+0000", 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5012999999999996e-05 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129946+0000", 2023-07-29T16:39:33.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0057153300000000002 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129984+0000", 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8532000000000003e-05 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130009+0000", 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4933999999999999e-05 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.156 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187673 5.7 5:e70486f8:::benchmark_data_smithi070_97781_object45888:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.126685+0000", 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003303215, 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0034018550000000001, 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.157 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187673 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126685+0000", 2023-07-29T16:39:33.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126685+0000", 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126685+0000", 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126687+0000", 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.503e-06 2023-07-29T16:39:33.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126692+0000", 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9359999999999998e-06 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126695+0000", 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.914e-06 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126725+0000", 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9933e-05 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.126803+0000", 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.7744999999999995e-05 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187674 5.9 5:995c7c5f:::benchmark_data_smithi070_97781_object45889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.127344+0000", 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002644637, 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002824633, 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:33.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187674 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127344+0000", 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127344+0000", 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127343+0000", 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127348+0000", 2023-07-29T16:39:33.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.763e-06 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127359+0000", 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0862999999999999e-05 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127366+0000", 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9399999999999996e-06 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127406+0000", 2023-07-29T16:39:33.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0893000000000003e-05 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127537+0000", 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000130436 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127651+0000", 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114469 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.171 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187675 5.f 5:fab2978e:::benchmark_data_smithi070_97781_object45890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.127753+0000", 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0022356559999999999, 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0025028899999999998, 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187675 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127753+0000", 2023-07-29T16:39:33.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127753+0000", 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127752+0000", 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127756+0000", 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.755e-06 2023-07-29T16:39:33.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127765+0000", 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9700000000000005e-06 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127771+0000", 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1449999999999996e-06 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127809+0000", 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8488000000000001e-05 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.127957+0000", 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000147107 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128098+0000", 2023-07-29T16:39:33.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000141378 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187677 5.3 5:c724cfb3:::benchmark_data_smithi070_97781_object45892:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.179 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.128729+0000", 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001259453, 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001616384, 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.180 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187677 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128729+0000", 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128729+0000", 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128728+0000", 2023-07-29T16:39:33.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128733+0000", 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7620000000000003e-06 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128741+0000", 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5140000000000001e-06 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128749+0000", 2023-07-29T16:39:33.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.17e-06 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128778+0000", 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9394e-05 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128878+0000", 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9769e-05 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187678 5.6 5:6d47202f:::benchmark_data_smithi070_97781_object45893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.128861+0000", 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0011277349999999999, 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015693199999999999, 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187678 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128861+0000", 2023-07-29T16:39:33.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128861+0000", 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128860+0000", 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128864+0000", 2023-07-29T16:39:33.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2610000000000004e-06 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128875+0000", 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0472000000000001e-05 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128881+0000", 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6889999999999998e-06 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.128918+0000", 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7110000000000002e-05 2023-07-29T16:39:33.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129035+0000", 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116329 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187680 5.f 5:f798b83d:::benchmark_data_smithi070_97781_object45895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.129316+0000", 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00067198599999999996, 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0011804059999999999, 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:33.194 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187680 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129316+0000", 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129316+0000", 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129316+0000", 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129320+0000", 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8039999999999999e-06 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129334+0000", 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4596000000000001e-05 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129346+0000", 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2051e-05 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130114+0000", 2023-07-29T16:39:33.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00076761500000000003 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130225+0000", 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110979 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130335+0000", 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000109967 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187681 5.7 5:e390350e:::benchmark_data_smithi070_97781_object45896:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.129356+0000", 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00063195600000000003, 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001225088, 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187681 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129356+0000", 2023-07-29T16:39:33.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129356+0000", 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129356+0000", 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129358+0000", 2023-07-29T16:39:33.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5160000000000001e-06 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129365+0000", 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4969999999999998e-06 2023-07-29T16:39:33.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129370+0000", 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2379999999999997e-06 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130102+0000", 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00073145700000000003 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130177+0000", 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5638999999999999e-05 2023-07-29T16:39:33.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:187682 5.3 5:c6ff4726:::benchmark_data_smithi070_97781_object45897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:33.129507+0000", 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00048132099999999999, 2023-07-29T16:39:33.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001148498, 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 187682 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.210 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129507+0000", 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129507+0000", 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129506+0000", 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129510+0000", 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4970000000000001e-06 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129519+0000", 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5869999999999999e-06 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.129527+0000", 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3640000000000001e-06 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130384+0000", 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000856744 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:33.130501+0000", 2023-07-29T16:39:33.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011794399999999999 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:39:33.216 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:33.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:33.218 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:33.216+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:33.318 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:33.316+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:33.403 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:33.404 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:33.404 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:33.404 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:33.405 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:33.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:33.421 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:33.416+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:33.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:33.521 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:33.517+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:33.623 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:33.620+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:33.628 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:33.648 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:33.649 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:33.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.446320145999998, 2023-07-29T16:39:33.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:33.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.651 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:33.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.652 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:33.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:33.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:33.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:33.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:33.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:33.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:33.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:33.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:33.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:33.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:33.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:33.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:33.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:33.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:33.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:33.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:33.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:33.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:33.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:33.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:33.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:33.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:33.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:33.675 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.675 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.677 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.677 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:33.678 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.228848272, 2023-07-29T16:39:33.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:33.679 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.680 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.680 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.680 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.681 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:33.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.682 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:33.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:33.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:33.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:33.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:33.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:33.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:33.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:33.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:33.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:33.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:33.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:33.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:33.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:33.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:33.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:33.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:33.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:33.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:33.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:33.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:33.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.226327859999998, 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:33.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:33.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:33.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:33.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.226206114, 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.717 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.718 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.718 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:33.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.719 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.719 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.719 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:33.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.720 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.720 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.720 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:33.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:33.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:33.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:33.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:33.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:33.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:33.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:33.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:33.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:33.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:33.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:33.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:33.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:33.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:33.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.733 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.734 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.734 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:33.734 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.225964148999999, 2023-07-29T16:39:33.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:33.735 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.735 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.735 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.736 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.736 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.736 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:33.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.737 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:33.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:33.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:33.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:33.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:33.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:33.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:33.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:33.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:33.750 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:33.751 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.225813895000002, 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.752 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.753 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:33.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.753 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:33.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:33.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:33.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:33.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:33.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:33.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.762 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.225691023000003, 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:33.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:33.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:33.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:33.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:33.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:33.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.774 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.774 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:33.774 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.225245889, 2023-07-29T16:39:33.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:33.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.775 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.775 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.776 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.776 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:33.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.776 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:33.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:33.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:33.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:33.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:33.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:33.785 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.786 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:33.787 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.225159740999999, 2023-07-29T16:39:33.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:33.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.787 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.787 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.789 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:33.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:33.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:33.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.797 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.224159598, 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.798 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:33.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:33.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:33.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:33.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:33.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:33.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:33.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:33.809 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 37.223825785000002, 2023-07-29T16:39:33.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:33.810 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.810 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:33.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:33.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:33.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:33.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:33.820 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.035523859000001, 2023-07-29T16:39:33.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:33.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:33.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:33.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:33.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:33.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:33.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:33.832 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.032958799999999, 2023-07-29T16:39:33.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:33.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:33.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:33.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:33.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.847 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.032658305999998, 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.848 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:33.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:33.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:33.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:33.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:33.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:33.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:33.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:33.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:33.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:33.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:33.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.017868493000002, 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.016967617999999, 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.878 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:33.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:33.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.008117865999999, 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.891 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:33.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:33.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:33.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:33.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:33.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:33.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:33.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:33.904 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.905 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.008036013000002, 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.906 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:33.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:33.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:33.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:33.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:33.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:33.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:33.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:33.919 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.919 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.919 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.920 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.920 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:33.920 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 19.007124473000001, 2023-07-29T16:39:33.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:33.921 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.921 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.921 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.921 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:33.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:33.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:33.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:33.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:33.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:33.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:33.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:33.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:33.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:33.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:33.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:33.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:33.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:33.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:33.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:33.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:33.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:33.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:33.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.989672204000001, 2023-07-29T16:39:33.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:33.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:33.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:33.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:33.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:33.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:33.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:33.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:33.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:33.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:33.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:33.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:33.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:33.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:33.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:33.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:33.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:33.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:33.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:33.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.954 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.954 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:33.955 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:33.955 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:33.956 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:33.957 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:33.958 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:33.959 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:33.959 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:33.953+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.057 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:34.054+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:34.132 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:34.132 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:34.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:34.191 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.188+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.258 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.255+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.315 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:34.315 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:34.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:34.359 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:34.356+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:34.461 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:34.457+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:34.537 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:34.538 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:34.553 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:34.599 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:34.596+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:34.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:39:34.661 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.658+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.733 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:34.733 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:34.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:34.763 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.760+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.864 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.861+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.965 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:34.962+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:34.977 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:34.977 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:34.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:35.066 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:35.062+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:35.166 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:35.163+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:35.182 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:35.182 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:35.192 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:35.267 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:35.265+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:35.370 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:35.367+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:35.376 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:35.377 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:35.392 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:35.470 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:35.467+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:35.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~42s 2023-07-29T16:39:35.571 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:35.568+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:35.611 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:35.612 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:35.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:35.657 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:39:35.672 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:35.669+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:35.772 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:35.770+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:35.796 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:35.796 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:35.809 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:35.873 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:35.870+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:35.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:35.976 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:35.972+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:35.990 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:35.991 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:36.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:36.075 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:36.072+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:36.106 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:36.127 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:36.127 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:36.127 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:36.128 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:36.130 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:36.130 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:36.177 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:36.174+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:36.224 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:36.224 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:36.225 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:36.225 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:36.225 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:36.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:36.277 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:36.274+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:36.378 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:36.376+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:36.460 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:36.460 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:36.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.258515348000003, 2023-07-29T16:39:36.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.462 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:36.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:36.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:36.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.471 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96627 5.f 5:febb723f:::benchmark_data_smithi070_97781_object96626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.041043473999999, 2023-07-29T16:39:36.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069427396000000002, 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96627 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.473 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414692+0000", 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414691+0000", 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414770+0000", 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8651000000000003e-05 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414776+0000", 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2879999999999998e-06 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414780+0000", 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.963e-06 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414817+0000", 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6696999999999998e-05 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.414924+0000", 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107076 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.415052+0000", 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012826100000000001 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.479 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417118+0000", 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020662300000000001 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484036+0000", 2023-07-29T16:39:36.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066918047999999994 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484083+0000", 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6192000000000001e-05 2023-07-29T16:39:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484119+0000", 2023-07-29T16:39:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6591000000000003e-05 2023-07-29T16:39:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96635 5.2 5:4de6f1ee:::benchmark_data_smithi070_97781_object96634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.038523062000003, 2023-07-29T16:39:36.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071325977999999998, 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96635 2023-07-29T16:39:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417212+0000", 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417211+0000", 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417238+0000", 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6974999999999998e-05 2023-07-29T16:39:36.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417253+0000", 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.4815e-05 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.488 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417261+0000", 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3229999999999998e-06 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2865000000000001e-05 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417461+0000", 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012646000000000001 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488418+0000", 2023-07-29T16:39:36.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070957280999999997 2023-07-29T16:39:36.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488465+0000", 2023-07-29T16:39:36.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7244999999999999e-05 2023-07-29T16:39:36.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.488538+0000", 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2866000000000003e-05 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.493 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96637 5.7 5:eac49262:::benchmark_data_smithi070_97781_object96636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.038401315999998, 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.069133589999999995, 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.494 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96637 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:36.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417334+0000", 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417333+0000", 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417358+0000", 2023-07-29T16:39:36.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4814e-05 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417365+0000", 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6699999999999997e-06 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.498 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417371+0000", 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1569999999999997e-06 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417405+0000", 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3624000000000002e-05 2023-07-29T16:39:36.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417534+0000", 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000129157 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486359+0000", 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068824772000000006 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486403+0000", 2023-07-29T16:39:36.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4694999999999998e-05 2023-07-29T16:39:36.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486467+0000", 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4261e-05 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.503 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96638 5.f 5:f33aba7d:::benchmark_data_smithi070_97781_object96637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.038159350999997, 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073374199000000001, 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.504 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96638 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417576+0000", 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417575+0000", 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417698+0000", 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000122843 2023-07-29T16:39:36.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417707+0000", 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7639999999999994e-06 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.508 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417715+0000", 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1140000000000006e-06 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418359+0000", 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00064399300000000004 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418494+0000", 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013553400000000001 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418827+0000", 2023-07-29T16:39:36.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000333102 2023-07-29T16:39:36.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484200+0000", 2023-07-29T16:39:36.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.065372166999999995 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490895+0000", 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066949710000000001 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490925+0000", 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0562999999999999e-05 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490950+0000", 2023-07-29T16:39:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4927e-05 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96639 5.7 5:e77f9d33:::benchmark_data_smithi070_97781_object96638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:36.514 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.038009097, 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.072202691999999999, 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96639 2023-07-29T16:39:36.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417726+0000", 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417725+0000", 2023-07-29T16:39:36.517 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417785+0000", 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9518999999999997e-05 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.518 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417793+0000", 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8359999999999992e-06 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417799+0000", 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0240000000000003e-06 2023-07-29T16:39:36.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419243+0000", 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001443799 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419328+0000", 2023-07-29T16:39:36.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5841999999999996e-05 2023-07-29T16:39:36.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489798+0000", 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070469377 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489850+0000", 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1799000000000003e-05 2023-07-29T16:39:36.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.489929+0000", 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9197999999999996e-05 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96641 5.7 5:eadb9d40:::benchmark_data_smithi070_97781_object96640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.037886225000001, 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073167284999999999, 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.524 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96641 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:36.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417849+0000", 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417872+0000", 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2966e-05 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417879+0000", 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3830000000000003e-06 2023-07-29T16:39:36.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.417884+0000", 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7890000000000002e-06 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484152+0000", 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066268516999999999 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484271+0000", 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000118719 2023-07-29T16:39:36.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490956+0000", 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066849559999999997 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490979+0000", 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3288000000000001e-05 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.491016+0000", 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7051000000000002e-05 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96645 5.7 5:efa9762d:::benchmark_data_smithi070_97781_object96644:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.037441090999998, 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.075270471000000005, 2023-07-29T16:39:36.534 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96645 2023-07-29T16:39:36.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418294+0000", 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418293+0000", 2023-07-29T16:39:36.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418360+0000", 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6983000000000006e-05 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418369+0000", 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3410000000000003e-06 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418375+0000", 2023-07-29T16:39:36.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9329999999999998e-06 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486503+0000", 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.068128446999999995 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.541 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486672+0000", 2023-07-29T16:39:36.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016899499999999999 2023-07-29T16:39:36.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.541 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493435+0000", 2023-07-29T16:39:36.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0067630390000000002 2023-07-29T16:39:36.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493484+0000", 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9345999999999998e-05 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493565+0000", 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0143999999999997e-05 2023-07-29T16:39:36.543 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96646 5.2 5:4426727b:::benchmark_data_smithi070_97781_object96645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:36.544 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.037354942999997, 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071930066000000001, 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96646 2023-07-29T16:39:36.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418380+0000", 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418409+0000", 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9740999999999999e-05 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418416+0000", 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5189999999999998e-06 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.418421+0000", 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2109999999999997e-06 2023-07-29T16:39:36.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419388+0000", 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00096709300000000003 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419516+0000", 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127274 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490165+0000", 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.070649711000000004 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490219+0000", 2023-07-29T16:39:36.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3965999999999998e-05 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490310+0000", 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.1063000000000005e-05 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.553 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96648 5.2 5:4ca8fb3a:::benchmark_data_smithi070_97781_object96647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.036354799999998, 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.071062669999999994, 2023-07-29T16:39:36.554 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96648 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:36.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419380+0000", 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419443+0000", 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3609999999999996e-05 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419453+0000", 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0246e-05 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419461+0000", 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.943e-06 2023-07-29T16:39:36.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.483990+0000", 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.064528763000000003 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.484115+0000", 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012509000000000001 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490322+0000", 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062070809999999997 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490368+0000", 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5312000000000003e-05 2023-07-29T16:39:36.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.490443+0000", 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5477999999999998e-05 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:96649 5.2 5:40a7d6d9:::benchmark_data_smithi070_97781_object96648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 40.036020987000001, 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.073866818000000001, 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.564 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 96649 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419714+0000", 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419769+0000", 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5537e-05 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419776+0000", 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9609999999999999e-06 2023-07-29T16:39:36.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.419781+0000", 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7790000000000003e-06 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486256+0000", 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.066475527000000006 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.486405+0000", 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014902399999999999 2023-07-29T16:39:36.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493434+0000", 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0070283749999999999 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493501+0000", 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6979999999999999e-05 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:56.493581+0000", 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0253000000000006e-05 2023-07-29T16:39:36.572 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.847719060999999, 2023-07-29T16:39:36.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:36.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:36.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:36.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:36.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:36.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.583 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.845154002000001, 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.584 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:36.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:36.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:36.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.596 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.844853508, 2023-07-29T16:39:36.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.598 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:36.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:36.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:36.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.830063695, 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:36.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:36.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:36.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:36.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.622 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.829162820000001, 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:36.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:36.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:36.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:36.634 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.634 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.634 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.820313068000001, 2023-07-29T16:39:36.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:36.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:36.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:36.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:36.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:36.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:36.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:36.647 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.820231215, 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:36.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:36.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:36.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:36.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:36.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.819319674999999, 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.660 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:36.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:36.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:36.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:36.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.671 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.801867406, 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:36.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:36.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:36.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:36.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:36.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:36.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:36.683 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:36.685 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:36.682+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:36.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:36.785 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:36.782+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:36.855 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:36.856 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:36.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:198260 5.9 e59/19 5:9a0ec644:::benchmark_data_smithi070_97781_object56475:head v 59'12400, mlcod=59'12396)", 2023-07-29T16:39:36.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.849659+0000", 2023-07-29T16:39:36.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0036634390000000001, 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036820780000000001, 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849659+0000", 2023-07-29T16:39:36.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849659+0000", 2023-07-29T16:39:36.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849659+0000", 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849664+0000", 2023-07-29T16:39:36.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2220000000000001e-06 2023-07-29T16:39:36.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849677+0000", 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748000000000001e-05 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849683+0000", 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2179999999999996e-06 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849712+0000", 2023-07-29T16:39:36.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8714e-05 2023-07-29T16:39:36.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.849732+0000", 2023-07-29T16:39:36.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0241000000000002e-05 2023-07-29T16:39:36.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.866 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:198262 5.9 e59/19 5:9840d2f6:::benchmark_data_smithi070_97781_object56477:head v 59'12401, mlcod=59'12396)", 2023-07-29T16:39:36.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.851018+0000", 2023-07-29T16:39:36.868 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0023051690000000001, 2023-07-29T16:39:36.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023849869999999999, 2023-07-29T16:39:36.868 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.869 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.869 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851018+0000", 2023-07-29T16:39:36.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851018+0000", 2023-07-29T16:39:36.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851017+0000", 2023-07-29T16:39:36.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851022+0000", 2023-07-29T16:39:36.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5959999999999997e-06 2023-07-29T16:39:36.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851030+0000", 2023-07-29T16:39:36.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8830000000000006e-06 2023-07-29T16:39:36.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851035+0000", 2023-07-29T16:39:36.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6879999999999996e-06 2023-07-29T16:39:36.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851059+0000", 2023-07-29T16:39:36.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3309e-05 2023-07-29T16:39:36.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851069+0000", 2023-07-29T16:39:36.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0648999999999999e-05 2023-07-29T16:39:36.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.879 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:198268 5.4 5:2307837e:::benchmark_data_smithi070_97781_object56483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:36.881 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.851057+0000", 2023-07-29T16:39:36.881 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00226611, 2023-07-29T16:39:36.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023830990000000001, 2023-07-29T16:39:36.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 198268 2023-07-29T16:39:36.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.883 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851057+0000", 2023-07-29T16:39:36.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851057+0000", 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851056+0000", 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851060+0000", 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4970000000000001e-06 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851068+0000", 2023-07-29T16:39:36.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4039999999999995e-06 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851075+0000", 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5699999999999998e-06 2023-07-29T16:39:36.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851110+0000", 2023-07-29T16:39:36.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5343999999999999e-05 2023-07-29T16:39:36.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851223+0000", 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112705 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:198269 5.e 5:79ea7a65:::benchmark_data_smithi070_97781_object56484:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.851116+0000", 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0022073560000000002, 2023-07-29T16:39:36.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023654180000000002, 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 198269 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.891 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851116+0000", 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851116+0000", 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851115+0000", 2023-07-29T16:39:36.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851118+0000", 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.399e-06 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851126+0000", 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5240000000000003e-06 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851133+0000", 2023-07-29T16:39:36.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0180000000000004e-06 2023-07-29T16:39:36.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851166+0000", 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2821999999999998e-05 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851292+0000", 2023-07-29T16:39:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012636599999999999 2023-07-29T16:39:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.899 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:198265 5.f e59/19 5:f1d7e7a2:::benchmark_data_smithi070_97781_object56480:head v 59'12357, mlcod=59'12355)", 2023-07-29T16:39:36.899 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.851205+0000", 2023-07-29T16:39:36.899 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0021174710000000001, 2023-07-29T16:39:36.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023147900000000002, 2023-07-29T16:39:36.900 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.900 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.900 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851205+0000", 2023-07-29T16:39:36.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851205+0000", 2023-07-29T16:39:36.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851205+0000", 2023-07-29T16:39:36.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851209+0000", 2023-07-29T16:39:36.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3869999999999997e-06 2023-07-29T16:39:36.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851216+0000", 2023-07-29T16:39:36.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6950000000000003e-06 2023-07-29T16:39:36.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851221+0000", 2023-07-29T16:39:36.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1669999999999998e-06 2023-07-29T16:39:36.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851261+0000", 2023-07-29T16:39:36.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9403999999999997e-05 2023-07-29T16:39:36.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851284+0000", 2023-07-29T16:39:36.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3113e-05 2023-07-29T16:39:36.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.912 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.912 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:198266 5.d e59/51 5:b8c3686d:::benchmark_data_smithi070_97781_object56481:head v 59'12382, mlcod=59'12380)", 2023-07-29T16:39:36.913 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.851402+0000", 2023-07-29T16:39:36.913 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001920768, 2023-07-29T16:39:36.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021525699999999999, 2023-07-29T16:39:36.914 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.914 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.914 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851402+0000", 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851402+0000", 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851402+0000", 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851406+0000", 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3100000000000002e-06 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851413+0000", 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2023-07-29T16:39:36.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851420+0000", 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2309999999999999e-06 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851456+0000", 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5828999999999999e-05 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.851476+0000", 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9607999999999999e-05 2023-07-29T16:39:36.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:198267 5.9 e59/19 5:94ceadb1:::benchmark_data_smithi070_97781_object56482:head v 59'12402, mlcod=59'12397)", 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.852556+0000", 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00076681700000000004, 2023-07-29T16:39:36.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010522610000000001, 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852556+0000", 2023-07-29T16:39:36.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852556+0000", 2023-07-29T16:39:36.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852556+0000", 2023-07-29T16:39:36.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:36.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852560+0000", 2023-07-29T16:39:36.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3529999999999997e-06 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852567+0000", 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5880000000000003e-06 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852572+0000", 2023-07-29T16:39:36.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2349999999999999e-06 2023-07-29T16:39:36.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852608+0000", 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6284e-05 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.852627+0000", 2023-07-29T16:39:36.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9043e-05 2023-07-29T16:39:36.928 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.928 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.929 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:198272 5.8 5:1dc43a87:::benchmark_data_smithi070_97781_object56487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:36.929 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:36.853298+0000", 2023-07-29T16:39:36.930 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.4930999999999999e-05, 2023-07-29T16:39:36.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036293499999999999, 2023-07-29T16:39:36.930 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:36.930 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:36.930 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:36.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:36.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:36.931 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 198272 2023-07-29T16:39:36.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853298+0000", 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853298+0000", 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:36.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853297+0000", 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853302+0000", 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8060000000000002e-06 2023-07-29T16:39:36.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:36.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853325+0000", 2023-07-29T16:39:36.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3295e-05 2023-07-29T16:39:36.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:36.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853332+0000", 2023-07-29T16:39:36.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5560000000000004e-06 2023-07-29T16:39:36.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:36.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853375+0000", 2023-07-29T16:39:36.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3331000000000002e-05 2023-07-29T16:39:36.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:36.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:36.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:36.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:36.853511+0000", 2023-07-29T16:39:36.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013569299999999999 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:36.939 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 8 2023-07-29T16:39:36.940 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:36.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:36.942 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:36.938+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.041 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:37.038+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.143 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:37.140+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:37.148 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:37.149 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:37.149 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:37.149 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:37.149 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:37.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:37.244 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:37.241+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:37.344 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:37.341+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.350 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:37.350 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:37.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.295630226, 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:37.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:37.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:37.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:37.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:37.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:37.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:37.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:37.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:37.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:37.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:37.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:37.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.295546395999999, 2023-07-29T16:39:37.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:37.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:37.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:37.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.293003431000002, 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:37.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:37.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:37.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:37.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:37.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:37.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:37.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:37.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:37.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:37.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.278243385000003, 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:37.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:37.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:37.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:37.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:37.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:37.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:37.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.250717338999998, 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:37.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:37.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:37.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:37.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:37.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.250557534999999, 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:37.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.420 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:37.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:37.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.431 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:37.431 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.246430383000003, 2023-07-29T16:39:37.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:37.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.433 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:37.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.433 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:37.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:37.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:37.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:37.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:37.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:37.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:37.442 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:37.443 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.240783577999998, 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:37.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:37.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:37.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:37.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.456 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.456 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:37.456 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.195794284999998, 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.457 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:37.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:37.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:37.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:37.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:37.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:37.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:37.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:37.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:37.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:37.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:37.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:37.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:37.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:37.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:37.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:37.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:37.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:37.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:37.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.473 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.474 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.474 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:37.475 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.138711377999996, 2023-07-29T16:39:37.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:37.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:37.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:37.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:37.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:37.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:37.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:37.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:37.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:37.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:37.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:37.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:37.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:37.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:37.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:37.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.138637295000002, 2023-07-29T16:39:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:37.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:37.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:37.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.506 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.138438880000002, 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.507 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:37.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.517 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.138057560999997, 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.518 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:37.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:37.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:37.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:37.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.136664437999997, 2023-07-29T16:39:37.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.529 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:37.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:37.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.66146861, 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:37.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:37.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:37.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.101170850000003, 2023-07-29T16:39:37.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:37.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:37.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:37.557 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.721517628000001, 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.558 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:37.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.032964462000002, 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.567 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:37.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:37.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:37.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.576 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.028069981000002, 2023-07-29T16:39:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.577 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:37.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:37.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.026402234999999, 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:37.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:37.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:37.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:37.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:37.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:37.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.595 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:37.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:37.596 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:37.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:37.598 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:37.594+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:39:37.699 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:37.696+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.776 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200681 5.c 5:3ef74eb6:::benchmark_data_smithi070_97781_object58896:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.764205+0000", 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0079121, 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0079377800000000002, 2023-07-29T16:39:37.777 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200681 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.778 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764205+0000", 2023-07-29T16:39:37.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764205+0000", 2023-07-29T16:39:37.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764205+0000", 2023-07-29T16:39:37.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764207+0000", 2023-07-29T16:39:37.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3379999999999999e-06 2023-07-29T16:39:37.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764213+0000", 2023-07-29T16:39:37.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4890000000000003e-06 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.764218+0000", 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9620000000000001e-06 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769141+0000", 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049236139999999998 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769258+0000", 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117175 2023-07-29T16:39:37.786 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200690 5.1 5:85bb7d11:::benchmark_data_smithi070_97781_object58905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.787 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.767578+0000", 2023-07-29T16:39:37.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004539281, 2023-07-29T16:39:37.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0046469939999999998, 2023-07-29T16:39:37.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.788 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.788 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200690 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.789 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767578+0000", 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767578+0000", 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767578+0000", 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767582+0000", 2023-07-29T16:39:37.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3710000000000002e-06 2023-07-29T16:39:37.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767588+0000", 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.891e-06 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767592+0000", 2023-07-29T16:39:37.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7169999999999999e-06 2023-07-29T16:39:37.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767620+0000", 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.775e-05 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.767695+0000", 2023-07-29T16:39:37.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4401999999999997e-05 2023-07-29T16:39:37.796 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.796 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.796 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.797 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200691 5.1 5:8808b8ab:::benchmark_data_smithi070_97781_object58906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.797 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.769448+0000", 2023-07-29T16:39:37.797 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0026696580000000001, 2023-07-29T16:39:37.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002832476, 2023-07-29T16:39:37.798 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.798 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.798 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.799 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200691 2023-07-29T16:39:37.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.800 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769448+0000", 2023-07-29T16:39:37.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769448+0000", 2023-07-29T16:39:37.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769447+0000", 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769453+0000", 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9349999999999999e-06 2023-07-29T16:39:37.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769465+0000", 2023-07-29T16:39:37.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2754e-05 2023-07-29T16:39:37.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769473+0000", 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2679999999999997e-06 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769504+0000", 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1717999999999997e-05 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769581+0000", 2023-07-29T16:39:37.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6178000000000001e-05 2023-07-29T16:39:37.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.808 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.808 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.809 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200692 5.1 5:8a25e43c:::benchmark_data_smithi070_97781_object58907:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.809 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.769623+0000", 2023-07-29T16:39:37.809 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.002493983, 2023-07-29T16:39:37.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002721228, 2023-07-29T16:39:37.809 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200692 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769623+0000", 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769623+0000", 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769623+0000", 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769626+0000", 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.5700000000000001e-06 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769634+0000", 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1450000000000002e-06 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.769639+0000", 2023-07-29T16:39:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5899999999999998e-06 2023-07-29T16:39:37.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770818+0000", 2023-07-29T16:39:37.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001178842 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770934+0000", 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116187 2023-07-29T16:39:37.816 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200695 5.9 5:9f5a443c:::benchmark_data_smithi070_97781_object58910:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.770292+0000", 2023-07-29T16:39:37.817 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001825349, 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021053320000000001, 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200695 2023-07-29T16:39:37.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770292+0000", 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770292+0000", 2023-07-29T16:39:37.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770291+0000", 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770296+0000", 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8500000000000002e-06 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770309+0000", 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3229e-05 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770316+0000", 2023-07-29T16:39:37.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.64e-06 2023-07-29T16:39:37.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770807+0000", 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00049103899999999997 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770910+0000", 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010304 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.771004+0000", 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3967000000000003e-05 2023-07-29T16:39:37.825 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200697 5.f 5:f23ebaf5:::benchmark_data_smithi070_97781_object58912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.826 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.770431+0000", 2023-07-29T16:39:37.827 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0016859659999999999, 2023-07-29T16:39:37.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020301500000000001, 2023-07-29T16:39:37.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.827 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:37.827 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200697 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770431+0000", 2023-07-29T16:39:37.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770431+0000", 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770431+0000", 2023-07-29T16:39:37.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770435+0000", 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6500000000000004e-06 2023-07-29T16:39:37.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770445+0000", 2023-07-29T16:39:37.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3840000000000003e-06 2023-07-29T16:39:37.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770451+0000", 2023-07-29T16:39:37.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5050000000000004e-06 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770491+0000", 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9833999999999998e-05 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770600+0000", 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010923499999999999 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770703+0000", 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000102361 2023-07-29T16:39:37.835 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200699 5.6 5:6ddd7533:::benchmark_data_smithi070_97781_object58914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.770465+0000", 2023-07-29T16:39:37.836 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0016524479999999999, 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020703380000000001, 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200699 2023-07-29T16:39:37.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770465+0000", 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770465+0000", 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770465+0000", 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770467+0000", 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0700000000000001e-06 2023-07-29T16:39:37.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770471+0000", 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4009999999999999e-06 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770474+0000", 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2389999999999998e-06 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770505+0000", 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0796000000000001e-05 2023-07-29T16:39:37.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770623+0000", 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011768 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.843 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200700 5.c 5:3bbfbda7:::benchmark_data_smithi070_97781_object58915:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.770481+0000", 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0016361539999999999, 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0021387210000000001, 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.844 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200700 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770481+0000", 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770481+0000", 2023-07-29T16:39:37.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770481+0000", 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770484+0000", 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.7690000000000001e-06 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770489+0000", 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.22e-06 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770492+0000", 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3900000000000002e-06 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770524+0000", 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.1538999999999997e-05 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.770626+0000", 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010196600000000001 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.851 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:200702 5.2 5:4349a57e:::benchmark_data_smithi070_97781_object58917:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.772413+0000", 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9997044, 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000282718, 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:37.852 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 200702 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772413+0000", 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772413+0000", 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772412+0000", 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772418+0000", 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2960000000000004e-06 2023-07-29T16:39:37.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772430+0000", 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1633e-05 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:37.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772439+0000", 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5990000000000002e-06 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772526+0000", 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7608000000000006e-05 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:37.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.772621+0000", 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4505000000000004e-05 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:37.858 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:37.859 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:39:37.859 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:37.860 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:37.857+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:37.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:37.961 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:37.958+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.036 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:38.036 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:38.037 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:38.037 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:38.037 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:38.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:38.092 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:38.089+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:38.162 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:38.159+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.263 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:38.260+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.281 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:38.283 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:38.284 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:38.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:38.284 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:38.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 46.082165934999999, 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.285 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:38.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:38.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:38.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:38.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:38.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:38.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:38.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:38.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:38.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:38.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:38.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:38.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:38.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:38.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:38.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:38.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:38.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:38.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:38.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:38.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:38.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.303 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:38.303 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.671369647999999, 2023-07-29T16:39:38.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:38.303 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.303 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:38.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.305 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:38.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:38.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:38.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:38.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:38.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.668804589000001, 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.316 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:38.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:38.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:38.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:38.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:38.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:38.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.328 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.668504094999999, 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:38.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:38.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:38.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:38.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:38.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.653714281999999, 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:38.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:38.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:38.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:38.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.652813407, 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.354 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:38.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:38.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:38.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:38.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.643963655, 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.366 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:38.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:38.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:38.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:38.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.377 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.643881801999999, 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:38.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:38.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:38.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.642970261999999, 2023-07-29T16:39:38.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.390 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:38.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:38.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:38.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.400 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.625517992999999, 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.401 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:38.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.406 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:38.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.018040466, 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:38.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:38.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:38.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:38.422 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.0156051070000001, 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.423 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:38.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:38.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:38.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.431 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.01551897, 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.432 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:38.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.015464299, 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.441 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:38.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:38.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:38.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:38.450 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.0148370879999999, 2023-07-29T16:39:38.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.014408113, 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:38.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:38.465 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.466 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:38.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.468 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.469 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.013214571, 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.470 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.472 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.473 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:38.474 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.475 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:38.476 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.477 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.0131851949999999, 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.479 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:38.480 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.481 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:38.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.483 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:38.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.485 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.486 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.487 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.012955796, 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.488 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.489 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.490 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:38.491 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.492 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:38.493 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.494 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:38.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.496 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:38.497 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 1.012854511, 2023-07-29T16:39:38.498 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.499 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.501 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:38.502 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.503 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:38.504 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:38.506 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:38.507 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:38.507 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:38.508 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:38.509 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:38.509 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:38.505+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:38.511 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:38.609 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:38.606+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:39:38.679 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:38.680 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:38.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:38.737 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:38.734+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:38.810 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:38.807+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:38.866 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:38.866 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:38.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:38.921 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:38.918+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.017 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.014+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.087 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:39.088 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:39.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:39.143 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.140+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.215 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.212+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.287 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:39.288 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:39.303 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:39.316 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.313+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.417 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.414+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.490 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:39.490 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:39.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:39.517 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:39.514+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:39.619 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:39.615+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:39.691 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:39.692 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:39.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:39.745 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:39.742+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:39.821 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:39.818+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:39.881 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:39.882 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:39.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:39.921 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:39.918+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:40.022 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:40.019+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:40.067 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:40.067 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:40.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:40.126 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:40.123+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:40.224 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:40.221+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:40.254 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:40.255 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:40.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:40.325 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:40.322+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:40.426 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:40.423+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:40.458 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:40.458 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:40.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:40.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:40.527 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:40.524+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:40.628 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:40.625+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:40.658 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:40.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:39:40.680 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:40.680 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:40.681 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:40.681 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:40.683 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:40.684 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:40.695 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:40.696 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:40.696 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:40.696 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:40.696 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:40.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:40.754 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:40.751+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:40.830 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:40.827+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:40.896 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:40.897 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:40.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:40.897 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:40.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.898 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:40.898 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:40.898 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.695146622999999, 2023-07-29T16:39:40.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:40.899 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.899 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:40.899 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:40.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:40.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:40.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:40.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.284350335999999, 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.910 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.911 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.911 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:40.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.911 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:40.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:40.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:40.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:40.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:40.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:40.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:40.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:40.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:40.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:40.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:40.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:40.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:40.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:40.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:40.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.923 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:40.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:40.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:40.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:40.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:40.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:40.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:40.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:40.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:40.927 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.927 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.927 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.928 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:40.929 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:40.929 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.281785277000001, 2023-07-29T16:39:40.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:40.929 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.929 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:40.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.930 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.930 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:40.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.931 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:40.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:40.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:40.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:40.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:40.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:40.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:40.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:40.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:40.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:40.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:40.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:40.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:40.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:40.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:40.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:40.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:40.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:40.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:40.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:40.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:40.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:40.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:40.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:40.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:40.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.281484783, 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:40.950 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:40.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:40.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:40.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:40.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:40.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:40.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:40.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:40.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:40.964 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.964 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.964 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.965 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:40.965 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.26669497, 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.966 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:40.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:40.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:40.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:40.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:40.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:40.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:40.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:40.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:40.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:40.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:40.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:40.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:40.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:40.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:40.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:40.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.982 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:40.982 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:40.982 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.265794095, 2023-07-29T16:39:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:40.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:40.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:40.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:40.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:40.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:40.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:40.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:40.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:40.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:40.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:40.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:40.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:40.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:40.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:40.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:40.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:40.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:40.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:40.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:40.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:40.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:40.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:40.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:40.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:40.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.999 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:40.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:40.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:40.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.256944343000001, 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.001 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:41.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.002 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:41.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:41.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:41.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:41.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:41.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:41.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:41.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:41.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:41.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:41.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:41.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:41.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:41.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:41.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:41.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:41.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:41.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:41.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:41.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.018 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.25686249, 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.019 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:41.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:41.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:41.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:41.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:41.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.255950949999999, 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:41.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:41.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 26.238498680999999, 2023-07-29T16:39:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.045 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.045 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:41.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.045 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:41.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:41.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:41.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:41.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:41.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.056 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6310211539999999, 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:41.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6285857950000002, 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.066 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:41.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:41.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:41.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:41.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.628499658, 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:41.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.628444987, 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:41.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:41.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:41.096 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6278177760000001, 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.097 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:41.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:41.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6273888009999999, 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.106 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:41.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:41.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:41.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.114 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6261952590000002, 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.115 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:41.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:41.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:41.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.123 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6261658830000001, 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.125 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:41.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:41.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:41.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.133 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.6259364839999999, 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:41.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:41.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:41.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 3.625835199, 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:41.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:41.145 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:41.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:41.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:41.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:41.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:41.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:41.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:41.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:41.153 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.154 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.154 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:41.154 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:41.154 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:41.156 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:41.152+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:41.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:41.256 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:41.253+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:41.337 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:41.337 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:41.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210911 5.8 5:1d1ac0ba:::benchmark_data_smithi070_97781_object69126:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.325770+0000", 2023-07-29T16:39:41.338 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0078253699999999999, 2023-07-29T16:39:41.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078554999999999996, 2023-07-29T16:39:41.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210911 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325770+0000", 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325770+0000", 2023-07-29T16:39:41.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325769+0000", 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325774+0000", 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2560000000000004e-06 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325784+0000", 2023-07-29T16:39:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0961000000000001e-05 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.325792+0000", 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1520000000000003e-06 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.327292+0000", 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015006869999999999 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.327417+0000", 2023-07-29T16:39:41.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124695 2023-07-29T16:39:41.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333547+0000", 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006129692 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333588+0000", 2023-07-29T16:39:41.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1575000000000001e-05 2023-07-29T16:39:41.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.349 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210920 5.8 5:16112f13:::benchmark_data_smithi070_97781_object69135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.328877+0000", 2023-07-29T16:39:41.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0047183870000000001, 2023-07-29T16:39:41.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048108350000000003, 2023-07-29T16:39:41.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210920 2023-07-29T16:39:41.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.354 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328877+0000", 2023-07-29T16:39:41.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328877+0000", 2023-07-29T16:39:41.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328877+0000", 2023-07-29T16:39:41.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328880+0000", 2023-07-29T16:39:41.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.897e-06 2023-07-29T16:39:41.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328888+0000", 2023-07-29T16:39:41.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2169999999999994e-06 2023-07-29T16:39:41.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328893+0000", 2023-07-29T16:39:41.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9529999999999998e-06 2023-07-29T16:39:41.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329636+0000", 2023-07-29T16:39:41.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074377600000000003 2023-07-29T16:39:41.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329783+0000", 2023-07-29T16:39:41.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014664999999999999 2023-07-29T16:39:41.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333685+0000", 2023-07-29T16:39:41.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039017430000000001 2023-07-29T16:39:41.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.367 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.368 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210921 5.b 5:d41cac45:::benchmark_data_smithi070_97781_object69136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.369 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.328900+0000", 2023-07-29T16:39:41.369 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0046953840000000004, 2023-07-29T16:39:41.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048359429999999997, 2023-07-29T16:39:41.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.371 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.371 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.371 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210921 2023-07-29T16:39:41.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.372 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328900+0000", 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328900+0000", 2023-07-29T16:39:41.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328900+0000", 2023-07-29T16:39:41.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328902+0000", 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3329999999999999e-06 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328908+0000", 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.451e-06 2023-07-29T16:39:41.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328912+0000", 2023-07-29T16:39:41.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.328967+0000", 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5135e-05 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329084+0000", 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011681299999999999 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210922 5.8 5:1a240ed6:::benchmark_data_smithi070_97781_object69137:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.329690+0000", 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039052449999999999, 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041095699999999999, 2023-07-29T16:39:41.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210922 2023-07-29T16:39:41.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.383 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329690+0000", 2023-07-29T16:39:41.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329690+0000", 2023-07-29T16:39:41.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329689+0000", 2023-07-29T16:39:41.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329694+0000", 2023-07-29T16:39:41.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0379999999999999e-06 2023-07-29T16:39:41.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329711+0000", 2023-07-29T16:39:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6413e-05 2023-07-29T16:39:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329718+0000", 2023-07-29T16:39:41.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4549999999999998e-06 2023-07-29T16:39:41.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331627+0000", 2023-07-29T16:39:41.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019085440000000001 2023-07-29T16:39:41.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331757+0000", 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130118 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210923 5.4 5:2278aba4:::benchmark_data_smithi070_97781_object69138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.329729+0000", 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0038669989999999999, 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041441309999999997, 2023-07-29T16:39:41.394 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210923 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.395 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329729+0000", 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329729+0000", 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329728+0000", 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329731+0000", 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6800000000000002e-06 2023-07-29T16:39:41.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329737+0000", 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9519999999999999e-06 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.329742+0000", 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9989999999999999e-06 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331200+0000", 2023-07-29T16:39:41.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001458541 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331364+0000", 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163783 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.401 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210925 5.b 5:d44bf264:::benchmark_data_smithi070_97781_object69140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.330653+0000", 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0029421410000000001, 2023-07-29T16:39:41.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032930619999999998, 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210925 2023-07-29T16:39:41.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330653+0000", 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330653+0000", 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330653+0000", 2023-07-29T16:39:41.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330657+0000", 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7169999999999999e-06 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330667+0000", 2023-07-29T16:39:41.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9019999999999994e-06 2023-07-29T16:39:41.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330674+0000", 2023-07-29T16:39:41.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0600000000000002e-06 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331175+0000", 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050046900000000002 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331361+0000", 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018594099999999999 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210926 5.b 5:d06b2055:::benchmark_data_smithi070_97781_object69141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.330686+0000", 2023-07-29T16:39:41.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002909979, 2023-07-29T16:39:41.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033360339999999999, 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210926 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330686+0000", 2023-07-29T16:39:41.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330686+0000", 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330685+0000", 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330688+0000", 2023-07-29T16:39:41.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1300000000000001e-06 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330694+0000", 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0909999999999998e-06 2023-07-29T16:39:41.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330699+0000", 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1780000000000002e-06 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333455+0000", 2023-07-29T16:39:41.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027556949999999998 2023-07-29T16:39:41.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333581+0000", 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012601499999999999 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210929 5.b 5.fd987e4b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.330959+0000", 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0026363110000000001, 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031340840000000001, 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210929 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.421 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330959+0000", 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330959+0000", 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330959+0000", 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330963+0000", 2023-07-29T16:39:41.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330971+0000", 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6969999999999999e-06 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.330978+0000", 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8410000000000002e-06 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210930 5.b 5.3cd25e6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.331620+0000", 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0019759069999999998, 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025314069999999998, 2023-07-29T16:39:41.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210930 2023-07-29T16:39:41.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331620+0000", 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331620+0000", 2023-07-29T16:39:41.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331619+0000", 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331623+0000", 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0289999999999999e-06 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331631+0000", 2023-07-29T16:39:41.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9200000000000004e-06 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.331638+0000", 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.525e-06 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:210932 5.9 e60/19 5:9d81fc28:::benchmark_data_smithi070_97781_object69147:head v 60'13198, mlcod=60'13196)", 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.332480+0000", 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0011156300000000001, 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001727379, 2023-07-29T16:39:41.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332480+0000", 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332480+0000", 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332479+0000", 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332484+0000", 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.403e-06 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332491+0000", 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.267e-06 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332495+0000", 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0040000000000001e-06 2023-07-29T16:39:41.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332525+0000", 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9567999999999999e-05 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.332539+0000", 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4171999999999999e-05 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:210935 5.d e60/51 5:b2b78776:::benchmark_data_smithi070_97781_object69150:head v 60'13203, mlcod=60'13201)", 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.333184+0000", 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00041133400000000002, 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001080508, 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333184+0000", 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333184+0000", 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333184+0000", 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333189+0000", 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2599999999999996e-06 2023-07-29T16:39:41.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333202+0000", 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2883e-05 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333208+0000", 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1850000000000001e-06 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333250+0000", 2023-07-29T16:39:41.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2011000000000001e-05 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333272+0000", 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1772000000000001e-05 2023-07-29T16:39:41.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210938 5.e 5:7eccf8c4:::benchmark_data_smithi070_97781_object69153:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.333726+0000", 2023-07-29T16:39:41.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998693, 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059771300000000004, 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210938 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333726+0000", 2023-07-29T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333726+0000", 2023-07-29T16:39:41.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333725+0000", 2023-07-29T16:39:41.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333730+0000", 2023-07-29T16:39:41.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1030000000000001e-06 2023-07-29T16:39:41.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333740+0000", 2023-07-29T16:39:41.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9089999999999995e-06 2023-07-29T16:39:41.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333747+0000", 2023-07-29T16:39:41.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3409999999999997e-06 2023-07-29T16:39:41.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333792+0000", 2023-07-29T16:39:41.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5092999999999997e-05 2023-07-29T16:39:41.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333939+0000", 2023-07-29T16:39:41.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146494 2023-07-29T16:39:41.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.462 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:210939 5.e 5.4ab3f92e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:41.333857+0000", 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9997387, 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000529154, 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 210939 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333857+0000", 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333857+0000", 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333856+0000", 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333860+0000", 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333870+0000", 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7680000000000003e-06 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:41.333877+0000", 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 13 2023-07-29T16:39:41.469 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:41.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:41.472 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:41.468+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:41.571 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:41.569+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:41.667 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:39:41.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~48s 2023-07-29T16:39:41.673 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:41.670+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:41.681 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:41.681 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:41.681 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:41.681 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:41.682 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:41.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:41.773 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:41.771+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:41.874 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:41.871+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:41.909 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:41.910 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:41.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:41.910 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:41.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.910 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.855379216999999, 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:41.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.912 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:41.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:41.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:41.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:41.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:41.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:41.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:41.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:41.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:41.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:41.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:41.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:41.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.925 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.855295386999998, 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:41.926 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.927 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:41.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:41.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:41.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:41.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:41.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:41.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:41.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:41.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:41.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:41.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:41.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:41.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.852752422000002, 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.942 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:41.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:41.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:41.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:41.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.954 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.837992376000003, 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.955 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:41.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:41.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:41.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:41.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:41.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:41.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:41.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:41.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:41.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:41.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:41.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:41.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:41.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:41.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:41.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:41.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:41.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:41.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:41.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:41.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810466329999997, 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.974 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:41.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:41.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:41.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:41.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:41.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:41.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:41.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.987 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:41.987 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:41.987 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810306525999998, 2023-07-29T16:39:41.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:41.988 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:41.988 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:41.988 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:41.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:41.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:41.989 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:41.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:41.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:41.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:41.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:41.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:41.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:41.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:41.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:42.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:42.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.000 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.806179374000003, 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:42.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:42.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:42.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:42.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:42.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:42.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:42.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.015 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.800532568999998, 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:42.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:42.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:42.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.755543275999997, 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:42.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:42.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:42.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:42.036 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.698460369000003, 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:42.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:42.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:42.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:42.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:42.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.698386286000002, 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:42.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:42.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:42.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.057 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.698187871000002, 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.058 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:42.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:42.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:42.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.697806552000003, 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:42.068 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:42.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:42.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:42.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.696413429000003, 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:42.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:42.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:42.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.088 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.221217600999999, 2023-07-29T16:39:42.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.090 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:42.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.660919841000002, 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:42.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:42.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.107 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.281266619, 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:42.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:42.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.592713453000002, 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:42.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:42.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:42.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:42.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.587818972000001, 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.126 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:42.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:42.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.586151225999998, 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:42.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:42.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:42.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:42.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:42.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:42.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:42.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:42.144 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:42.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:42.146 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:42.142+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:42.246 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:42.243+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:42.327 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:42.327 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:42.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213872 5.f 5.dfa95baf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.324201+0000", 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00066668599999999999, 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00068167100000000001, 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213872 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324201+0000", 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324201+0000", 2023-07-29T16:39:42.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324200+0000", 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324203+0000", 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2490000000000001e-06 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324211+0000", 2023-07-29T16:39:42.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1250000000000004e-06 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324216+0000", 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.485e-06 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213878 5.6 5.b57e3fa6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.324840+0000", 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 2.7718000000000001e-05, 2023-07-29T16:39:42.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0105999999999995e-05, 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213878 2023-07-29T16:39:42.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324840+0000", 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324840+0000", 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324839+0000", 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324844+0000", 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7099999999999998e-06 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324854+0000", 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004e-05 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324861+0000", 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6879999999999999e-06 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.341 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213857 5.3 5:c54de1ea:::benchmark_data_smithi070_97781_object72072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.319711+0000", 2023-07-29T16:39:42.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0051568229999999996, 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0052433929999999998, 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213857 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319711+0000", 2023-07-29T16:39:42.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319711+0000", 2023-07-29T16:39:42.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319710+0000", 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319713+0000", 2023-07-29T16:39:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.667e-06 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319719+0000", 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5529999999999998e-06 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319724+0000", 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.1030000000000001e-06 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.321033+0000", 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001308853 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.321123+0000", 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9518000000000006e-05 2023-07-29T16:39:42.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213859 5.d 5:b9b7ca66:::benchmark_data_smithi070_97781_object72074:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.319908+0000", 2023-07-29T16:39:42.351 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0049590550000000004, 2023-07-29T16:39:42.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050830240000000002, 2023-07-29T16:39:42.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.352 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:42.352 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.352 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213859 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319908+0000", 2023-07-29T16:39:42.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319908+0000", 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319908+0000", 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319912+0000", 2023-07-29T16:39:42.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0949999999999998e-06 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319920+0000", 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3529999999999995e-06 2023-07-29T16:39:42.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.319927+0000", 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3960000000000003e-06 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.321670+0000", 2023-07-29T16:39:42.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001743421 2023-07-29T16:39:42.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.321793+0000", 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012347899999999999 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.321911+0000", 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011800500000000001 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.359 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213865 5.7 5:e91be94c:::benchmark_data_smithi070_97781_object72080:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.322399+0000", 2023-07-29T16:39:42.360 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0024681429999999999, 2023-07-29T16:39:42.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0026335450000000002, 2023-07-29T16:39:42.361 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.361 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:42.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.362 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.362 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213865 2023-07-29T16:39:42.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.362 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322399+0000", 2023-07-29T16:39:42.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322399+0000", 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322398+0000", 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322402+0000", 2023-07-29T16:39:42.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9620000000000004e-06 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322411+0000", 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1510000000000004e-06 2023-07-29T16:39:42.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.322417+0000", 2023-07-29T16:39:42.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4060000000000002e-06 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323876+0000", 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014591420000000001 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324002+0000", 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000125559 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213866 5.3 5:c9b86b1e:::benchmark_data_smithi070_97781_object72081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.323852+0000", 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0010158210000000001, 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012179440000000001, 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:42.370 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213866 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323852+0000", 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323852+0000", 2023-07-29T16:39:42.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323851+0000", 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323855+0000", 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6519999999999997e-06 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323866+0000", 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0237999999999999e-05 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323873+0000", 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4100000000000002e-06 2023-07-29T16:39:42.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323909+0000", 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6400999999999999e-05 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324041+0000", 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000131848 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213868 5.7 5.f0ffcda7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.323894+0000", 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00097290099999999997, 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001210486, 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:42.378 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213868 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323894+0000", 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323894+0000", 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323894+0000", 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323898+0000", 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0550000000000001e-06 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323905+0000", 2023-07-29T16:39:42.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8789999999999997e-06 2023-07-29T16:39:42.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323911+0000", 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8540000000000002e-06 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.384 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213869 5.d 5:b6920361:::benchmark_data_smithi070_97781_object72084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.323919+0000", 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00094853500000000002, 2023-07-29T16:39:42.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0012166290000000001, 2023-07-29T16:39:42.386 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.386 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:42.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.387 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213869 2023-07-29T16:39:42.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.387 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323919+0000", 2023-07-29T16:39:42.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323919+0000", 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323918+0000", 2023-07-29T16:39:42.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323921+0000", 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6539999999999999e-06 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323928+0000", 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5440000000000004e-06 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.323933+0000", 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3539999999999999e-06 2023-07-29T16:39:42.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324054+0000", 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012122599999999999 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324168+0000", 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011424799999999999 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324280+0000", 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011195499999999999 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.396 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:213871 5.c 5:342e78e5:::benchmark_data_smithi070_97781_object72086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:42.324159+0000", 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00070817000000000005, 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0010178310000000001, 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.397 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 213871 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324159+0000", 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324159+0000", 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324158+0000", 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324163+0000", 2023-07-29T16:39:42.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9139999999999999e-06 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324182+0000", 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.8899999999999999e-05 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324189+0000", 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1250000000000004e-06 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324228+0000", 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8185000000000001e-05 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:42.324346+0000", 2023-07-29T16:39:42.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011874099999999999 2023-07-29T16:39:42.404 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.404 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.404 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.404 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.405 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:42.405 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:39:42.405 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:42.407 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:42.408 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:42.404+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:42.507 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:42.504+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:42.582 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:42.583 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:42.583 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:42.583 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:42.583 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:42.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:42.607 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:42.604+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:42.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:42.709 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:42.706+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:42.809 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:42.806+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:42.822 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:42.822 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:42.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:42.823 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:42.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.823 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:42.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:42.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.619740960999998, 2023-07-29T16:39:42.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:42.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.826 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.826 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:42.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.826 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:42.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:42.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:42.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:42.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:42.837 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.208944674000001, 2023-07-29T16:39:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:42.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:42.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:42.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:42.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:42.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:42.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:42.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:42.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:42.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:42.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:42.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:42.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:42.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:42.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:42.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.852 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.853 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.854 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:42.854 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.206379614999999, 2023-07-29T16:39:42.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:42.854 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.855 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.855 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.856 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:42.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.856 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:42.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:42.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:42.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:42.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:42.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:42.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:42.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:42.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:42.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:42.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:42.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:42.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:42.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:42.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:42.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.873 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.206079120999998, 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:42.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:42.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:42.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:42.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.886 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.191289308000002, 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:42.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:42.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:42.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.190388432999999, 2023-07-29T16:39:42.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.900 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:42.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:42.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:42.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.181538680999999, 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.911 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:42.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:42.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:42.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:42.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.181456828000002, 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:42.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:42.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.934 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.180545288000001, 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.935 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:42.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:42.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:42.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:42.945 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 28.163093019000002, 2023-07-29T16:39:42.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.947 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:42.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:42.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5556154920000003, 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:42.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:42.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5531801329999997, 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.967 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:42.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:42.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.975 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5530939960000003, 2023-07-29T16:39:42.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.977 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:42.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:42.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:42.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5530393250000003, 2023-07-29T16:39:42.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.986 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:42.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:42.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:42.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.552412114, 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:42.996 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:42.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:42.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:43.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5519831389999998, 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:43.005 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:43.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:43.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:43.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:43.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5507895969999996, 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:43.014 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:43.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:43.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:43.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.022 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.550760221, 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:43.023 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:43.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:43.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:43.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5505308219999998, 2023-07-29T16:39:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 5.5504295370000003, 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:43.052 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:43.053 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:43.053 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:43.054 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:43.050+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:43.054 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:43.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:43.056 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:43.056 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:43.154 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.151+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:43.231 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:43.231 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:43.245 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:43.286 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.283+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:43.355 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:43.352+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:43.457 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.454+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:43.466 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:43.466 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:43.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:43.556 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:43.554+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:43.657 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.654+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:43.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:39:43.685 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:43.685 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:43.700 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:43.758 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.755+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:43.859 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:43.856+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:43.880 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:43.880 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:43.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:43.960 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:43.957+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.061 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.058+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.111 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:44.111 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:44.125 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:44.162 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.159+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.263 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.260+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.305 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:44.306 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:44.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:44.364 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.361+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.465 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.462+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.488 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:44.489 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:44.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:44.566 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:44.563+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:44.667 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.664+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:39:44.702 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:44.703 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:44.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:44.768 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:44.765+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:44.869 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:44.866+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:44.952 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:44.996 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:44.993+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:45.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:45.071 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:45.068+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:45.134 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:45.135 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:45.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:45.192 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:45.189+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:45.205 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:45.228 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:45.231 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:45.231 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:45.278 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:45.275+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:45.372 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:45.373 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:45.374 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:45.374 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:45.374 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:45.379 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:45.377+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:45.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:45.481 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:45.478+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:45.581 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:45.579+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:45.608 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:45.609 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:45.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:45.609 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:45.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.609 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:45.610 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:45.610 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.406984497000003, 2023-07-29T16:39:45.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:45.610 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.610 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.611 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.611 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:45.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.99618821, 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.622 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:45.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:45.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:45.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:45.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:45.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.634 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.993623151000001, 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.635 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:45.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:45.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:45.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:45.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:45.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.993322657, 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:45.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:45.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:45.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.978532844, 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:45.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:45.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:45.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:45.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.977631969000001, 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:45.678 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.679 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:45.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:45.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:45.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:45.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.691 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.968782217000001, 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:45.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:45.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:45.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:45.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.699 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:45.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:45.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:45.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:45.704 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.705 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.968700364, 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.706 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:45.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.709 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:45.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.719 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.719 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:45.719 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.967788823999999, 2023-07-29T16:39:45.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:45.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:45.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:45.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:45.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:45.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.950336555, 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:45.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.740 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:45.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:45.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:45.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.745 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3428590279999995, 2023-07-29T16:39:45.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.749 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:45.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:45.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3404236689999998, 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.757 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:45.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:45.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.767 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3403375319999995, 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.768 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:45.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:45.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:45.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.777 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3402828610000004, 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.778 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:45.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:45.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:45.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.788 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.789 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3396556499999992, 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.790 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:45.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:45.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:45.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.799 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:45.800 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3392266750000008, 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.802 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:45.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.802 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:45.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:45.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:45.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:45.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:45.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:45.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:45.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:45.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:45.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:45.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:45.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:45.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:45.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:45.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:45.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:45.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:45.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:45.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:45.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.817 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.818 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.819 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:45.819 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3380331329999997, 2023-07-29T16:39:45.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:45.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.820 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.821 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:45.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.821 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:45.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.824 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:45.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:45.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:45.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:45.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:45.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:45.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:45.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:45.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:45.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:45.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:45.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:45.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:45.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:45.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:45.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:45.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:45.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:45.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.839 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.839 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:45.839 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3380037569999992, 2023-07-29T16:39:45.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:45.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.840 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.841 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.841 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:45.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.842 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:45.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:45.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:45.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:45.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:45.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:45.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:45.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:45.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:45.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:45.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:45.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:45.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:45.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:45.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:45.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:45.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:45.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:45.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:45.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.858 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.858 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.859 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.859 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:45.859 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3377743580000008, 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.860 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:45.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:45.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:45.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:45.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:45.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:45.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:45.871 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.871 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.872 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.873 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:45.873 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:45.873 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 8.3376730729999995, 2023-07-29T16:39:45.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:45.874 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:45.874 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:45.874 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:45.875 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:45.875 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:45.875 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:45.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.876 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:45.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:45.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:45.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:45.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:45.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:45.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:45.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:45.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:45.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:45.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:45.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:45.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:45.887 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:45.887 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:45.888 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:45.885+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:45.888 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:45.989 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:45.987+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:46.060 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224456 5.4 5:2c05dfb1:::benchmark_data_smithi070_97781_object82671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.050234+0000", 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0070281409999999999, 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070476480000000001, 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224456 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050234+0000", 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050234+0000", 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050234+0000", 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050236+0000", 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3e-06 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050241+0000", 2023-07-29T16:39:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.729e-06 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050246+0000", 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1170000000000003e-06 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050281+0000", 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5370000000000002e-05 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050393+0000", 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011201699999999999 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224458 5.a 5:5e168231:::benchmark_data_smithi070_97781_object82673:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.050546+0000", 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0067161230000000001, 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067804620000000001, 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224458 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050546+0000", 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050546+0000", 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050545+0000", 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050550+0000", 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4909999999999999e-06 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050558+0000", 2023-07-29T16:39:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.816e-06 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050565+0000", 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4119999999999998e-06 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050610+0000", 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4987999999999997e-05 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050740+0000", 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013062100000000001 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224459 5.4 5:2093d022:::benchmark_data_smithi070_97781_object82674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.050577+0000", 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0066853290000000003, 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067901580000000001, 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224459 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050577+0000", 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050577+0000", 2023-07-29T16:39:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050576+0000", 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050579+0000", 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499999999999998e-06 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050585+0000", 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7450000000000001e-06 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.050589+0000", 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6500000000000004e-06 2023-07-29T16:39:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052689+0000", 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020997170000000001 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052775+0000", 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5696000000000001e-05 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:224461 5.f e62/19 5:fddfb7e7:::benchmark_data_smithi070_97781_object82676:head v 62'13904, mlcod=62'13901)", 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.052621+0000", 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0046411129999999997, 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00478372, 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052621+0000", 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052621+0000", 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052620+0000", 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052627+0000", 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4559999999999997e-06 2023-07-29T16:39:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052636+0000", 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3260000000000002e-06 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052643+0000", 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052688+0000", 2023-07-29T16:39:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5587999999999998e-05 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052708+0000", 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9666000000000001e-05 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224463 5.8 5:1ac376ca:::benchmark_data_smithi070_97781_object82678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.052967+0000", 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0042950059999999997, 2023-07-29T16:39:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044730439999999998, 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224463 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052967+0000", 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052967+0000", 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052966+0000", 2023-07-29T16:39:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052971+0000", 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5090000000000004e-06 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052981+0000", 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0721e-05 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.052990+0000", 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053026+0000", 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5899999999999998e-05 2023-07-29T16:39:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053109+0000", 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3024999999999999e-05 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224464 5.0 5:09d62a9b:::benchmark_data_smithi070_97781_object82679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.053071+0000", 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041908830000000003, 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044174879999999998, 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224464 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053071+0000", 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053071+0000", 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053071+0000", 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053074+0000", 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.557e-06 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053086+0000", 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2216e-05 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053093+0000", 2023-07-29T16:39:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2330000000000003e-06 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053134+0000", 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1758000000000002e-05 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053267+0000", 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013273000000000001 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224465 5.4 5:2b680a67:::benchmark_data_smithi070_97781_object82680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.053102+0000", 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041600600000000001, 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044317890000000002, 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224465 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053102+0000", 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053102+0000", 2023-07-29T16:39:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053102+0000", 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053104+0000", 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8490000000000002e-06 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053110+0000", 2023-07-29T16:39:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.806e-06 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053116+0000", 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7520000000000002e-06 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054053+0000", 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00093731999999999995 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054184+0000", 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013041999999999999 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224467 5.4 5:2e66f82f:::benchmark_data_smithi070_97781_object82682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.053129+0000", 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041332310000000002, 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004443621, 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224467 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053129+0000", 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053129+0000", 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053128+0000", 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053131+0000", 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2060000000000001e-06 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053137+0000", 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.857e-06 2023-07-29T16:39:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.053142+0000", 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0420000000000002e-06 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055681+0000", 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025398560000000001 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055825+0000", 2023-07-29T16:39:46.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014347399999999999 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224469 5.b 5:db583161:::benchmark_data_smithi070_97781_object82684:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.054431+0000", 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028314, 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031916660000000001, 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224469 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054431+0000", 2023-07-29T16:39:46.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054431+0000", 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054430+0000", 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054433+0000", 2023-07-29T16:39:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3129999999999999e-06 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054442+0000", 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6319999999999997e-06 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054448+0000", 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4269999999999996e-06 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054480+0000", 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1603000000000002e-05 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054595+0000", 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011489000000000001 2023-07-29T16:39:46.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:224468 5.f e62/19 5:f7a10087:::benchmark_data_smithi070_97781_object82683:head v 62'13905, mlcod=62'13902)", 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.054701+0000", 2023-07-29T16:39:46.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0025607009999999999, 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029851579999999999, 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054701+0000", 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054701+0000", 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054701+0000", 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054707+0000", 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2090000000000002e-06 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054720+0000", 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.274e-05 2023-07-29T16:39:46.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054726+0000", 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1349999999999997e-06 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054765+0000", 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8979000000000001e-05 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.054787+0000", 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2246e-05 2023-07-29T16:39:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224470 5.0 5:0f312cb3:::benchmark_data_smithi070_97781_object82685:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.055375+0000", 2023-07-29T16:39:46.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001886567, 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023455450000000001, 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224470 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055375+0000", 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055375+0000", 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055375+0000", 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055380+0000", 2023-07-29T16:39:46.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3399999999999997e-06 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055389+0000", 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3190000000000001e-06 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055397+0000", 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6490000000000008e-06 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055673+0000", 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027597599999999999 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055815+0000", 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142103 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:224473 5.e 5:7208bd4c:::benchmark_data_smithi070_97781_object82688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.055839+0000", 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001423262, 2023-07-29T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001937715, 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 224473 2023-07-29T16:39:46.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055839+0000", 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055839+0000", 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055838+0000", 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055843+0000", 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9729999999999997e-06 2023-07-29T16:39:46.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055853+0000", 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8859999999999999e-06 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055860+0000", 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.754e-06 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055899+0000", 2023-07-29T16:39:46.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9344000000000001e-05 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.056017+0000", 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011796 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:224471 5.d e62/51 5:b8cdc626:::benchmark_data_smithi070_97781_object82686:head v 62'14067, mlcod=62'14065)", 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.055882+0000", 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0013799159999999999, 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019628689999999999, 2023-07-29T16:39:46.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055882+0000", 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055882+0000", 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055882+0000", 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055887+0000", 2023-07-29T16:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2920000000000003e-06 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055894+0000", 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999999e-06 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055899+0000", 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2809999999999999e-06 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055946+0000", 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6391999999999999e-05 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.055964+0000", 2023-07-29T16:39:46.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7761000000000002e-05 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:224472 5.d e62/51 5:b8eaa3c0:::benchmark_data_smithi070_97781_object82687:head v 62'14068, mlcod=62'14065)", 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:46.057422+0000", 2023-07-29T16:39:46.161 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998403, 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000474976, 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057422+0000", 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057422+0000", 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057421+0000", 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057427+0000", 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1340000000000001e-06 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057440+0000", 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3001e-05 2023-07-29T16:39:46.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057447+0000", 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5250000000000002e-06 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057476+0000", 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9045000000000001e-05 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:46.057489+0000", 2023-07-29T16:39:46.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2850999999999999e-05 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 14 2023-07-29T16:39:46.168 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:46.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:46.170 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.166+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.270 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:46.268+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:46.371 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.368+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.380 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:46.381 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:46.381 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:46.381 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:46.381 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:46.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:46.480 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.477+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.573 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.570+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.596 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:46.596 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:46.597 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.542217262000001, 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.598 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:46.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:46.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:46.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.609 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.542133432, 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.610 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:46.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:46.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.539590466999996, 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:46.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:46.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:46.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:46.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.524830420999997, 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:46.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:46.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:46.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.497304374999999, 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:46.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:46.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:46.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.497144571, 2023-07-29T16:39:46.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:46.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:46.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:46.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.493017418999997, 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:46.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:46.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:46.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.487370614, 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:46.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:46.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:46.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:46.689 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.442381320999999, 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:46.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:46.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:46.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:46.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.700 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.385298413999998, 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:46.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:46.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:46.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:46.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.385224331000003, 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:46.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:46.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:46.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.385025916000004, 2023-07-29T16:39:46.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:46.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:46.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:46.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:46.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:46.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.384644596999998, 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:46.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:46.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:46.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.383251473999998, 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:46.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:46.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:46.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:46.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.908055646000001, 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:46.757 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.758 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:46.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:46.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:46.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.347757885999997, 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.767 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:46.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:46.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.968104664000002, 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:46.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:46.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.279551498000004, 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:46.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.796 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.274657017000003, 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:46.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:46.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:46.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:46.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:46.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.272989271, 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:46.807 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:46.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:46.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:46.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:46.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:46.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:46.816 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:46.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:39:46.818 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:46.819 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.814+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.918 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:46.915+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:46.999 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227094 5.5 5:a4ea12c7:::benchmark_data_smithi070_97781_object85309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.990401+0000", 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0068296750000000003, 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0068546470000000002, 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227094 2023-07-29T16:39:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990401+0000", 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990401+0000", 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990401+0000", 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:47.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990406+0000", 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.49e-06 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990416+0000", 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0032e-05 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990423+0000", 2023-07-29T16:39:47.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4420000000000001e-06 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993189+0000", 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002765595 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993293+0000", 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000104007 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227095 5.d 5:b6ba4712:::benchmark_data_smithi070_97781_object85310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.990512+0000", 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0067192370000000003, 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0068219789999999997, 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227095 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990512+0000", 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990512+0000", 2023-07-29T16:39:47.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990511+0000", 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990515+0000", 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4329999999999997e-06 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990524+0000", 2023-07-29T16:39:47.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3790000000000006e-06 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.990530+0000", 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.178e-06 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.016 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993184+0000", 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002654329 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993325+0000", 2023-07-29T16:39:47.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014070700000000001 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993437+0000", 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000112176 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227101 5.5 5:a0404928:::benchmark_data_smithi070_97781_object85316:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.992248+0000", 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0049833789999999996, 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0051576909999999998, 2023-07-29T16:39:47.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227101 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992248+0000", 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992248+0000", 2023-07-29T16:39:47.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992247+0000", 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992252+0000", 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992261+0000", 2023-07-29T16:39:47.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7830000000000004e-06 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.992268+0000", 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8490000000000006e-06 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994211+0000", 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001942697 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994287+0000", 2023-07-29T16:39:47.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5632999999999999e-05 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227102 5.2 5:46cca6fb:::benchmark_data_smithi070_97781_object85317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.993599+0000", 2023-07-29T16:39:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0036320670000000001, 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038708359999999999, 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227102 2023-07-29T16:39:47.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993599+0000", 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993599+0000", 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993598+0000", 2023-07-29T16:39:47.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993603+0000", 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9180000000000002e-06 2023-07-29T16:39:47.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993615+0000", 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1637999999999999e-05 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993623+0000", 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5969999999999992e-06 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993663+0000", 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9926999999999999e-05 2023-07-29T16:39:47.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993791+0000", 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012810400000000001 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227103 5.9 5:9277672b:::benchmark_data_smithi070_97781_object85318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.993744+0000", 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0034867489999999999, 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0037930419999999999, 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:47.034 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227103 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993744+0000", 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993744+0000", 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993744+0000", 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.037 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993747+0000", 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.568e-06 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993754+0000", 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2420000000000003e-06 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993760+0000", 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3900000000000001e-06 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993803+0000", 2023-07-29T16:39:47.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3466e-05 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993930+0000", 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012714099999999999 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994047+0000", 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000116926 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227104 5.9 5:91769350:::benchmark_data_smithi070_97781_object85319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.993769+0000", 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0034614699999999999, 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0038389869999999999, 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227104 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993769+0000", 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993769+0000", 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993769+0000", 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993771+0000", 2023-07-29T16:39:47.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1009999999999999e-06 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993777+0000", 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4190000000000001e-06 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.993781+0000", 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6410000000000001e-06 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.996048+0000", 2023-07-29T16:39:47.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002267163 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.996163+0000", 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000114601 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.996273+0000", 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110017 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.049 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227105 5.6 5:6b6bd856:::benchmark_data_smithi070_97781_object85320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.994458+0000", 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0027733160000000001, 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032292380000000002, 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227105 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994458+0000", 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994458+0000", 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994457+0000", 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994461+0000", 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4539999999999999e-06 2023-07-29T16:39:47.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994470+0000", 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6900000000000004e-06 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994476+0000", 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5899999999999998e-06 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994518+0000", 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1893e-05 2023-07-29T16:39:47.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.994655+0000", 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013773799999999999 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227108 5.3 5:c4940577:::benchmark_data_smithi070_97781_object85323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.995771+0000", 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001459852, 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0019742409999999998, 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.057 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227108 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995771+0000", 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995771+0000", 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995770+0000", 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995775+0000", 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0840000000000002e-06 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995783+0000", 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2840000000000006e-06 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995789+0000", 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2750000000000001e-06 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995830+0000", 2023-07-29T16:39:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0706e-05 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.995971+0000", 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014131699999999999 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.063 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:227111 5.7 5:e3e52298:::benchmark_data_smithi070_97781_object85326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:46.997596+0000", 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 4294967295.9996352, 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00019079000000000001, 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:47.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 227111 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997596+0000", 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997596+0000", 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:47.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997595+0000", 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:47.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997599+0000", 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2629999999999997e-06 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997607+0000", 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0120000000000005e-06 2023-07-29T16:39:47.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997613+0000", 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2800000000000003e-06 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:47.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997658+0000", 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5232999999999999e-05 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:46.997755+0000", 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6626000000000006e-05 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.070 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:47.071 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:39:47.071 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:47.072 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.069+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:47.173 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:47.171+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:47.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:47.256 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:47.257 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:47.257 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:47.257 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:47.258 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:47.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:47.274 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.271+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.375 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.372+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.381 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:47.401 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:47.402 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:47.402 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:47.403 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:47.404 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:47.405 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:47.476 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.473+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.487 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:47.487 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:47.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:47.578 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:47.576+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:47.662 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:47.663 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:47.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:47.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~54s 2023-07-29T16:39:47.678 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.675+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.683 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:39:47.779 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:47.776+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:47.848 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:47.848 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:47.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:47.880 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:47.878+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:47.981 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:47.979+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.070 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:48.070 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:48.082 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.081+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:48.183 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.181+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.266 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:48.266 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:48.281 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:48.284 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:48.281+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:48.385 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.384+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.486 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.484+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.496 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:48.496 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:48.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:48.587 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:48.584+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:48.688 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.687+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.726 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:48.727 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:48.742 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:48.790 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:48.787+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:48.891 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:48.889+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:48.909 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:48.910 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:48.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:49.007 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.004+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.093 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:49.092+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:49.142 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:49.142 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:49.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:49.194 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:49.192+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:49.295 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.292+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.372 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:49.373 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:49.386 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:49.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:49.428 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.425+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.496 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.493+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.555 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:49.558 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:49.558 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:49.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:49.575 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:49.576 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:49.576 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:49.576 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:49.578 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:49.579 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:49.616 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:49.614+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:49.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:39:49.698 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.694+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.748 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:49.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:49.749 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:49.749 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:49.749 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:49.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:49.804 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:49.802+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:49.900 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:49.897+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:49.992 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:49.992 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:49.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:49.992 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.788867426000003, 2023-07-29T16:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:49.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:49.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:50.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:50.003 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:50.004 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.378071138999999, 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.005 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:50.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:50.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:50.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:50.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:50.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.016 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.375506080000001, 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.017 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:50.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:50.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:50.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:50.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:50.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:50.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:50.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:50.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:50.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:50.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:50.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:50.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:50.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:50.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:50.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:50.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:50.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.035 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.375205586, 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:50.036 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:50.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:50.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:50.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:50.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.360415773, 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:50.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:50.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:50.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:50.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:50.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.359514898, 2023-07-29T16:39:50.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:50.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:50.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.350665145999997, 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.074 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:50.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.350583293, 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.086 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:50.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:50.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:50.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:50.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:50.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.349671753000003, 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:50.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:50.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:50.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.108 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 35.332219483999999, 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:50.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:50.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:50.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:50.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:50.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.120 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.724741956999999, 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.121 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:50.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:50.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.129 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.722306597999999, 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:50.130 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:50.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:50.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:50.138 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.722220460999999, 2023-07-29T16:39:50.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.140 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:50.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:50.147 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.72216579, 2023-07-29T16:39:50.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:50.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:50.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:50.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.158 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.721538579000001, 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:50.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:50.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:50.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.721109604, 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.168 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:50.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:50.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:50.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.719916061999999, 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.177 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:50.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.719886686000001, 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.186 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:50.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:50.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:50.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.719657287, 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:50.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:50.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:50.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:50.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:50.205 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 12.719556002000001, 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:50.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:50.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:50.214 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:50.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:50.216 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:50.212+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:50.316 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:50.314+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:50.388 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236462 5.d e63/51 5:b33a6811:::benchmark_data_smithi070_97781_object94677:head v 63'14831, mlcod=63'14829)", 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.378637+0000", 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.006760851, 2023-07-29T16:39:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067794129999999998, 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378637+0000", 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378637+0000", 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378637+0000", 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378644+0000", 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3679999999999996e-06 2023-07-29T16:39:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378653+0000", 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4349999999999997e-06 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378658+0000", 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8849999999999998e-06 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378700+0000", 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2882e-05 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.378726+0000", 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5491e-05 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236467 5.4 5:2483cd3c:::benchmark_data_smithi070_97781_object94682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.380875+0000", 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004522865, 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045998860000000001, 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236467 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380875+0000", 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380875+0000", 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380874+0000", 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380879+0000", 2023-07-29T16:39:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4900000000000002e-06 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380888+0000", 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.867e-06 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380893+0000", 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2000000000000002e-06 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380929+0000", 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6103999999999999e-05 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381058+0000", 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012886899999999999 2023-07-29T16:39:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236468 5.b 5:dd23f14b:::benchmark_data_smithi070_97781_object94683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.380903+0000", 2023-07-29T16:39:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0044949500000000002, 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046175280000000001, 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236468 2023-07-29T16:39:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380903+0000", 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380903+0000", 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380903+0000", 2023-07-29T16:39:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380905+0000", 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0020000000000001e-06 2023-07-29T16:39:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380912+0000", 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1459999999999999e-06 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380915+0000", 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1700000000000001e-06 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.380950+0000", 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4390000000000001e-05 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381061+0000", 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110989 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236474 5.8 5:11f9f2df:::benchmark_data_smithi070_97781_object94689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.381221+0000", 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041775140000000002, 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004341213, 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236474 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381221+0000", 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381221+0000", 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381220+0000", 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381223+0000", 2023-07-29T16:39:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0960000000000001e-06 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381230+0000", 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8539999999999999e-06 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381235+0000", 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5199999999999999e-06 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381275+0000", 2023-07-29T16:39:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0389000000000002e-05 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381405+0000", 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012965000000000001 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236475 5.a 5:57111500:::benchmark_data_smithi070_97781_object94690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.381242+0000", 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00415585, 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044002249999999998, 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236475 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381242+0000", 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381242+0000", 2023-07-29T16:39:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381242+0000", 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381244+0000", 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3989999999999998e-06 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381249+0000", 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8910000000000003e-06 2023-07-29T16:39:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381253+0000", 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.23e-06 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381286+0000", 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3757000000000002e-05 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381374+0000", 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7357999999999999e-05 2023-07-29T16:39:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236466 5.d e63/51 5:b1365f4c:::benchmark_data_smithi070_97781_object94681:head v 63'14832, mlcod=63'14829)", 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.381268+0000", 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041301419999999998, 2023-07-29T16:39:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044513280000000001, 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381268+0000", 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381268+0000", 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381268+0000", 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381272+0000", 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5700000000000003e-06 2023-07-29T16:39:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381279+0000", 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4049999999999997e-06 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381284+0000", 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2780000000000001e-06 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381317+0000", 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3127999999999999e-05 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381337+0000", 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0203999999999998e-05 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236473 5.f e63/19 5:f5c645d8:::benchmark_data_smithi070_97781_object94688:head v 63'14645, mlcod=63'14643)", 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.381454+0000", 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039446439999999998, 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043356050000000002, 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381454+0000", 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381454+0000", 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381453+0000", 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381458+0000", 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.096e-06 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381466+0000", 2023-07-29T16:39:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3499999999999999e-06 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381471+0000", 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8080000000000001e-06 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381639+0000", 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016741999999999999 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381658+0000", 2023-07-29T16:39:50.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199e-05 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236476 5.b 5:df86fc20:::benchmark_data_smithi070_97781_object94691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.381963+0000", 2023-07-29T16:39:50.438 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.003435413, 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038935150000000002, 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236476 2023-07-29T16:39:50.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381963+0000", 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381963+0000", 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381962+0000", 2023-07-29T16:39:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381966+0000", 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3590000000000001e-06 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381978+0000", 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.182e-05 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.381985+0000", 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5599999999999999e-06 2023-07-29T16:39:50.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383144+0000", 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011594050000000001 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383296+0000", 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015191599999999999 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.445 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236469 5.d e63/51 5:b0f21b67:::benchmark_data_smithi070_97781_object94684:head v 63'14833, mlcod=63'14829)", 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.383210+0000", 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0021882949999999998, 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027228299999999999, 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383210+0000", 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383210+0000", 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383209+0000", 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383215+0000", 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.789e-06 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383223+0000", 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9489999999999996e-06 2023-07-29T16:39:50.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383229+0000", 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9649999999999996e-06 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383269+0000", 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0116e-05 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383336+0000", 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6421999999999995e-05 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.451 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236478 5.8 5:1850720e:::benchmark_data_smithi070_97781_object94693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.383614+0000", 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00178433, 2023-07-29T16:39:50.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023802630000000001, 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236478 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383614+0000", 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383614+0000", 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383613+0000", 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383618+0000", 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8500000000000002e-06 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383630+0000", 2023-07-29T16:39:50.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2388999999999999e-05 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383639+0000", 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1279999999999997e-06 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383677+0000", 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7253999999999999e-05 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383800+0000", 2023-07-29T16:39:50.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012349 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236477 5.9 e63/19 5:945c48fe:::benchmark_data_smithi070_97781_object94692:head v 63'14770, mlcod=63'14766)", 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.383656+0000", 2023-07-29T16:39:50.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001742277, 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002404228, 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383656+0000", 2023-07-29T16:39:50.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383656+0000", 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383656+0000", 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383660+0000", 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1540000000000004e-06 2023-07-29T16:39:50.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383669+0000", 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6900000000000004e-06 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383674+0000", 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6999999999999999e-06 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383709+0000", 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4909000000000001e-05 2023-07-29T16:39:50.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.383728+0000", 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8587e-05 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:236471 5.d e63/51 5:b20d9afa:::benchmark_data_smithi070_97781_object94686:head v 63'14834, mlcod=63'14829)", 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.384479+0000", 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00091938999999999996, 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001637381, 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384479+0000", 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384479+0000", 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384478+0000", 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384483+0000", 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1529999999999999e-06 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384494+0000", 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.187e-05 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.384500+0000", 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5060000000000003e-06 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385064+0000", 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00056365199999999999 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385086+0000", 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2625000000000001e-05 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236480 5.b 5:d43e0d9f:::benchmark_data_smithi070_97781_object94695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.385409+0000", 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.999989, 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076642400000000003, 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236480 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385409+0000", 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385409+0000", 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385408+0000", 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385413+0000", 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3749999999999996e-06 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385423+0000", 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0609e-05 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385429+0000", 2023-07-29T16:39:50.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6099999999999997e-06 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385465+0000", 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6245000000000003e-05 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385571+0000", 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105729 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236481 5.a 5:5be40bb7:::benchmark_data_smithi070_97781_object94696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.385438+0000", 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9999604, 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00080416899999999998, 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236481 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385438+0000", 2023-07-29T16:39:50.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385438+0000", 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385437+0000", 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385440+0000", 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7980000000000001e-06 2023-07-29T16:39:50.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385446+0000", 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1789999999999996e-06 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385452+0000", 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6919999999999999e-06 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385494+0000", 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1998e-05 2023-07-29T16:39:50.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385589+0000", 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4992000000000001e-05 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:236482 5.e 5:7de9f00a:::benchmark_data_smithi070_97781_object94697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:50.385539+0000", 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998589, 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076799500000000005, 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:50.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 236482 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385539+0000", 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385539+0000", 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385539+0000", 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385543+0000", 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9020000000000001e-06 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385550+0000", 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8019999999999992e-06 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385557+0000", 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4230000000000002e-06 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385606+0000", 2023-07-29T16:39:50.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9691999999999998e-05 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:50.385738+0000", 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013171999999999999 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.494 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:50.494 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 15 2023-07-29T16:39:50.494 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:50.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:50.496 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:50.493+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:50.595 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:50.593+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:50.664 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:50.665 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:50.665 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:50.665 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:50.665 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:50.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:39:50.721 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:50.717+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:50.797 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:50.794+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.840659930999998, 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:50.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:50.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:50.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:50.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.840576101000003, 2023-07-29T16:39:50.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:50.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:50.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:50.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.838033136, 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:50.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:50.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:50.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:50.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:50.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.927 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.823273090000001, 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:50.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:50.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:50.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.937 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.795747044000002, 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:50.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:50.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:50.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.948 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.795587240000003, 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:50.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:50.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:50.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:50.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.958 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.791460088000001, 2023-07-29T16:39:50.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.960 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:50.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:50.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.969 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.970 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.785813283000003, 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:50.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:50.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:50.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.740823990000003, 2023-07-29T16:39:50.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:50.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:50.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:50.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:50.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.683741083000001, 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:50.992 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:50.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:50.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:50.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:50.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:50.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:51.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:51.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.683667, 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:51.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:51.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:51.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:51.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:51.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.683468585, 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.013 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:51.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:51.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:51.023 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.683087266000001, 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:51.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.025 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:51.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:51.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:51.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:51.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:51.034 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.681694143000001, 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:51.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:51.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:51.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:51.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:51.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.206498314999997, 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.045 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:51.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.646200555, 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:51.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:51.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:51.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.266547332999998, 2023-07-29T16:39:51.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:51.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:51.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.577994167, 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.073 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:51.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:51.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.081 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.573099685999999, 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:51.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:51.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:51.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.571431939999997, 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:51.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:51.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:51.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:51.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:51.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:51.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:51.100 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:51.100 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:51.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:51.102 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:51.099+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:51.202 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:51.199+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:51.280 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:51.280 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238980 5.f 5:fc44fb61:::benchmark_data_smithi070_97781_object97195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.269272+0000", 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0080708329999999995, 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0080894839999999992, 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.281 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238980 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269272+0000", 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269272+0000", 2023-07-29T16:39:51.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269271+0000", 2023-07-29T16:39:51.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269276+0000", 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7659999999999998e-06 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269290+0000", 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3991999999999999e-05 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269301+0000", 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0771000000000001e-05 2023-07-29T16:39:51.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270667+0000", 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013657719999999999 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270751+0000", 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4845000000000005e-05 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:51.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270837+0000", 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.5498e-05 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276198+0000", 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053609199999999999 2023-07-29T16:39:51.289 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238982 5.6 5:6e702571:::benchmark_data_smithi070_97781_object97197:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.291 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.269580+0000", 2023-07-29T16:39:51.291 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0077624440000000003, 2023-07-29T16:39:51.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0078398530000000008, 2023-07-29T16:39:51.291 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.291 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238982 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269580+0000", 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269580+0000", 2023-07-29T16:39:51.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269580+0000", 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269584+0000", 2023-07-29T16:39:51.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8260000000000003e-06 2023-07-29T16:39:51.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269592+0000", 2023-07-29T16:39:51.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2879999999999993e-06 2023-07-29T16:39:51.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.269597+0000", 2023-07-29T16:39:51.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4960000000000004e-06 2023-07-29T16:39:51.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.271813+0000", 2023-07-29T16:39:51.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022161419999999999 2023-07-29T16:39:51.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.271944+0000", 2023-07-29T16:39:51.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013073699999999999 2023-07-29T16:39:51.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.302 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.302 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.303 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238988 5.2 5:4b70c91f:::benchmark_data_smithi070_97781_object97203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.303 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.270785+0000", 2023-07-29T16:39:51.303 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0065578340000000002, 2023-07-29T16:39:51.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0066920840000000001, 2023-07-29T16:39:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238988 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270785+0000", 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270785+0000", 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270784+0000", 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270789+0000", 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4730000000000002e-06 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270797+0000", 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.602e-06 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270804+0000", 2023-07-29T16:39:51.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6279999999999999e-06 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270859+0000", 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5214999999999999e-05 2023-07-29T16:39:51.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.270977+0000", 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117961 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.312 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238989 5.c 5:31f74d1f:::benchmark_data_smithi070_97781_object97204:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.312 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.272622+0000", 2023-07-29T16:39:51.312 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004720938, 2023-07-29T16:39:51.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049033439999999996, 2023-07-29T16:39:51.313 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.314 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238989 2023-07-29T16:39:51.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272622+0000", 2023-07-29T16:39:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272622+0000", 2023-07-29T16:39:51.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272621+0000", 2023-07-29T16:39:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272625+0000", 2023-07-29T16:39:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0720000000000001e-06 2023-07-29T16:39:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272638+0000", 2023-07-29T16:39:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2873e-05 2023-07-29T16:39:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272645+0000", 2023-07-29T16:39:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0129999999999996e-06 2023-07-29T16:39:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272684+0000", 2023-07-29T16:39:51.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9295000000000002e-05 2023-07-29T16:39:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272802+0000", 2023-07-29T16:39:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117482 2023-07-29T16:39:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.326 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.327 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238990 5.2 5:407c95e4:::benchmark_data_smithi070_97781_object97205:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.272655+0000", 2023-07-29T16:39:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.004688027, 2023-07-29T16:39:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049158930000000002, 2023-07-29T16:39:51.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.329 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238990 2023-07-29T16:39:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272655+0000", 2023-07-29T16:39:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272655+0000", 2023-07-29T16:39:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272654+0000", 2023-07-29T16:39:51.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272657+0000", 2023-07-29T16:39:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6790000000000001e-06 2023-07-29T16:39:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272663+0000", 2023-07-29T16:39:51.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3520000000000003e-06 2023-07-29T16:39:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272674+0000", 2023-07-29T16:39:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0437e-05 2023-07-29T16:39:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272824+0000", 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015008600000000001 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272951+0000", 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000127429 2023-07-29T16:39:51.340 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238991 5.3 5:c29eb636:::benchmark_data_smithi070_97781_object97206:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.272738+0000", 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0046046860000000002, 2023-07-29T16:39:51.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048728240000000004, 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238991 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.342 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272738+0000", 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272738+0000", 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272738+0000", 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272741+0000", 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3119999999999998e-06 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272749+0000", 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.011e-06 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272755+0000", 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1040000000000003e-06 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272795+0000", 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0222999999999998e-05 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272918+0000", 2023-07-29T16:39:51.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012316700000000001 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238992 5.f 5:ffffe2f3:::benchmark_data_smithi070_97781_object97207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.348 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.272770+0000", 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0045731900000000004, 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0048818969999999996, 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.349 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238992 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272770+0000", 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272770+0000", 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272769+0000", 2023-07-29T16:39:51.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272772+0000", 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8080000000000001e-06 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272778+0000", 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0929999999999999e-06 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272783+0000", 2023-07-29T16:39:51.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3510000000000001e-06 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.274324+0000", 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015400660000000001 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.274400+0000", 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6289000000000001e-05 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.274466+0000", 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6089999999999999e-05 2023-07-29T16:39:51.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276293+0000", 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018275349999999999 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.356 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:238993 5.2 5:454a56ef:::benchmark_data_smithi070_97781_object97208:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.272792+0000", 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0045512790000000001, 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0049401130000000003, 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.357 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 238993 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272792+0000", 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272792+0000", 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272791+0000", 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272793+0000", 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2649999999999999e-06 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272801+0000", 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2799999999999998e-06 2023-07-29T16:39:51.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.272806+0000", 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.344e-06 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.274501+0000", 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001694498 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.274634+0000", 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013307 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:239000 5.5 5:afcda443:::benchmark_data_smithi070_97781_object97215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.275365+0000", 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0019776759999999998, 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024419530000000002, 2023-07-29T16:39:51.364 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 239000 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.365 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275365+0000", 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275365+0000", 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275364+0000", 2023-07-29T16:39:51.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275370+0000", 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7780000000000004e-06 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275380+0000", 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0477e-05 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275388+0000", 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6399999999999997e-06 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275429+0000", 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0683000000000003e-05 2023-07-29T16:39:51.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275553+0000", 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012470600000000001 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:239001 5.7 5:e784a2b5:::benchmark_data_smithi070_97781_object97216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.275405+0000", 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00193764, 2023-07-29T16:39:51.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0024647319999999999, 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.373 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 239001 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275405+0000", 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275405+0000", 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275405+0000", 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275408+0000", 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9790000000000002e-06 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275414+0000", 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5629999999999997e-06 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275419+0000", 2023-07-29T16:39:51.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9289999999999997e-06 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275445+0000", 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5939999999999999e-05 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.275520+0000", 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5208000000000002e-05 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:239003 5.5 5:ac454cf2:::benchmark_data_smithi070_97781_object97218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.276678+0000", 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00066517200000000001, 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001262476, 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.380 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 239003 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276678+0000", 2023-07-29T16:39:51.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276678+0000", 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276677+0000", 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276681+0000", 2023-07-29T16:39:51.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2019999999999997e-06 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276691+0000", 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0081000000000001e-05 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276698+0000", 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.409e-06 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.277288+0000", 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00059030499999999995 2023-07-29T16:39:51.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.277421+0000", 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013255999999999999 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:239005 5.5 5.6387b2f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:51.276958+0000", 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00038467599999999997, 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001050938, 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:51.387 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 239005 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276958+0000", 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276958+0000", 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276958+0000", 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:51.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276962+0000", 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0729999999999998e-06 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276970+0000", 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.9019999999999999e-06 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:51.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:51.276976+0000", 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2020000000000001e-06 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:51.392 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:51.393 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 12 2023-07-29T16:39:51.393 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:51.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:51.395 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:51.391+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:51.494 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:51.492+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:51.572 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:51.572 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:51.573 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:51.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:51.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:51.627 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:51.625+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:51.695 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:51.693+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:51.733 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:51.757 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:51.757 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:51.757 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:51.758 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:51.760 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:51.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:51.796 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:51.795+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:51.809 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:51.810 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:51.815 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:51.898 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:51.895+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:51.980 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:51.980 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:51.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:52.034 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:52.031+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:52.099 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:52.097+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:52.195 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:52.195 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:52.202 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:52.198+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:52.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:52.301 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:52.299+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:52.384 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:52.385 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:52.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:52.402 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:52.399+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:52.502 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:52.499+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:52.569 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:52.569 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:52.584 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:52.603 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:52.600+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:52.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:39:52.704 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:52.702+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:52.772 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:52.772 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:52.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:52.806 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:52.802+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:52.907 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:52.905+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:53.005 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:53.005 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:53.007 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.004+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.019 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:53.109 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:53.107+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:53.189 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:53.189 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:53.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:53.248 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.245+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.310 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:53.308+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:53.371 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:53.371 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:53.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:53.426 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.423+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-07-29T16:39:53.511 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.508+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.587 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:53.588 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:53.600 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:53.644 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:53.642+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:39:53.712 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.709+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:53.779 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:53.779 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:53.792 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:53.813 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:53.810+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:53.908 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:53.914 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:53.913+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:53.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:53.928 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:53.928 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:53.928 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:53.930 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:53.931 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:54.010 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:54.011 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:54.011 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:54.011 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:54.011 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:54.018 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:54.016+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:54.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:54.117 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:54.116+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:54.218 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:54.215+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:54.242 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:54.243 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:54.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:54.243 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:54.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.243 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 62.041261487, 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.245 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.245 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:54.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.245 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:54.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:54.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:54.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:54.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:54.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:54.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.630465200000003, 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:54.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.257 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:54.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:54.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:54.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.265 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.627900140999998, 2023-07-29T16:39:54.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.267 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:54.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:54.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.627599646999997, 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:54.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:54.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:54.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:54.292 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.612809833999997, 2023-07-29T16:39:54.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:54.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:54.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:54.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:54.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:54.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:54.305 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.611908958999997, 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.306 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:54.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:54.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:54.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:54.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:54.317 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.603059207000001, 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:54.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:54.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:54.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:54.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:54.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.602977353999997, 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.330 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:54.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:54.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:54.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:54.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.602065813999999, 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:54.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:54.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:54.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:54.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.353 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 39.584613545000003, 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:54.354 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.355 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:54.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:54.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:54.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:54.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.977136017999999, 2023-07-29T16:39:54.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:54.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:54.369 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.370 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:54.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:54.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.974700659, 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.376 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.379 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:54.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:54.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.385 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.974614522, 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:54.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.390 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:54.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:54.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.394 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.974559850999999, 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.399 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.400 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:54.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.403 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:54.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.973932640000001, 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.406 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.407 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.410 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:54.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.412 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:54.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.415 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.973503664999999, 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.416 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:54.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:54.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.420 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:54.421 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:54.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.424 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.972310123, 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:54.425 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.429 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:54.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:54.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.434 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.972280746999999, 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.435 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:54.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:54.439 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:54.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.444 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.972051348000001, 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.445 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:54.446 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.447 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:54.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:54.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:54.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:54.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:54.455 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 16.971950063000001, 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.456 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:54.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:54.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:54.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:54.465 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:54.465 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:54.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:54.467 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:54.463+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:54.567 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:54.565+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:54.637 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:248243 5.e 5:70c37bad:::benchmark_data_smithi070_97781_object106458:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.631123+0000", 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0033669669999999998, 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033854480000000001, 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 248243 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631123+0000", 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631123+0000", 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631123+0000", 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631127+0000", 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4710000000000001e-06 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631136+0000", 2023-07-29T16:39:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2909999999999996e-06 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631145+0000", 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2719999999999997e-06 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631235+0000", 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0168999999999997e-05 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631394+0000", 2023-07-29T16:39:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015920800000000001 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:248247 5.0 5:0021e562:::benchmark_data_smithi070_97781_object106462:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.631308+0000", 2023-07-29T16:39:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0031826509999999999, 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032458230000000001, 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 248247 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631308+0000", 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631308+0000", 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631307+0000", 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631309+0000", 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.413e-06 2023-07-29T16:39:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631317+0000", 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631322+0000", 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9609999999999996e-06 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631353+0000", 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1495999999999998e-05 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631440+0000", 2023-07-29T16:39:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6619000000000005e-05 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:248244 5.f e65/19 5:f9abbf58:::benchmark_data_smithi070_97781_object106459:head v 65'15358, mlcod=65'15355)", 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.631503+0000", 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002987656, 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030931740000000002, 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631503+0000", 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631503+0000", 2023-07-29T16:39:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631502+0000", 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631506+0000", 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.619e-06 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631510+0000", 2023-07-29T16:39:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4880000000000001e-06 2023-07-29T16:39:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631514+0000", 2023-07-29T16:39:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0779999999999997e-06 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631547+0000", 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2873000000000002e-05 2023-07-29T16:39:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.631566+0000", 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8688000000000001e-05 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:248245 5.f e65/19 5:ff95b052:::benchmark_data_smithi070_97781_object106460:head v 65'15359, mlcod=65'15355)", 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.633238+0000", 2023-07-29T16:39:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001252045, 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013975839999999999, 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633238+0000", 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633238+0000", 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633238+0000", 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633242+0000", 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3409999999999996e-06 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633250+0000", 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6559999999999992e-06 2023-07-29T16:39:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633265+0000", 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5605000000000001e-05 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633305+0000", 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0173999999999999e-05 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633327+0000", 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1971999999999999e-05 2023-07-29T16:39:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:248249 5.4 5:2a4c23c6:::benchmark_data_smithi070_97781_object106464:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.633539+0000", 2023-07-29T16:39:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00095148599999999998, 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011318529999999999, 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 248249 2023-07-29T16:39:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633539+0000", 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633539+0000", 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633538+0000", 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633541+0000", 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.824e-06 2023-07-29T16:39:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633547+0000", 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633552+0000", 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3579999999999996e-06 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633579+0000", 2023-07-29T16:39:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7239000000000001e-05 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633657+0000", 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7741e-05 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:248250 5.e 5:76fc7cfb:::benchmark_data_smithi070_97781_object106465:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.633726+0000", 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00076409700000000004, 2023-07-29T16:39:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098151800000000002, 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 248250 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633726+0000", 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633726+0000", 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633726+0000", 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633728+0000", 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633732+0000", 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1339999999999997e-06 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633740+0000", 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4470000000000006e-06 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633783+0000", 2023-07-29T16:39:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2522999999999999e-05 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633911+0000", 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012789 2023-07-29T16:39:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:248251 5.9 e65/19 5:9ec3cac4:::benchmark_data_smithi070_97781_object106466:head v 65'15517, mlcod=65'15515)", 2023-07-29T16:39:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:54.633978+0000", 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00051189900000000001, 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076511999999999999, 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633978+0000", 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633978+0000", 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633978+0000", 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633983+0000", 2023-07-29T16:39:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7700000000000001e-06 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633989+0000", 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0209999999999996e-06 2023-07-29T16:39:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.633993+0000", 2023-07-29T16:39:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2050000000000004e-06 2023-07-29T16:39:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.634029+0000", 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5979999999999998e-05 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:54.634046+0000", 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7368999999999999e-05 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:39:54.694 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:54.696 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:54.696 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:54.692+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:54.796 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:54.793+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:54.897 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:54.895+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:54.903 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:54.904 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:54.904 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:54.904 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:54.904 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:54.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:55.001 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:54.998+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:55.100 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:55.098+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:55.134 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:55.134 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:55.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:55.135 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:55.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.079550863999998, 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.079467033999997, 2023-07-29T16:39:55.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:55.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:55.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:55.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:55.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.076924069, 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:55.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:55.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:55.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.167 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.062164023000001, 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.168 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:55.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:55.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:55.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.177 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.034637977000003, 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:55.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.034478172999997, 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:55.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:55.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:55.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:55.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.030351021000001, 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.200 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:55.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:55.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:55.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:55.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.024704216000003, 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:55.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:55.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:55.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.979714923000003, 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:55.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:55.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:55.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.922632016000001, 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:55.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:55.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:55.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:55.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.922557933, 2023-07-29T16:39:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:55.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:55.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:55.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.922359518, 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:55.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.263 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.921978199000002, 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:55.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:55.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.920585076000002, 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:55.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:55.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.445389247999998, 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:55.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:55.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:55.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.885091488, 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:55.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:55.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:55.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:55.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:55.303 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.505438265999999, 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.304 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:55.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:55.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:55.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.8168851, 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:55.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:55.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:55.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:55.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.811990618999999, 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:55.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:55.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:55.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810322872999997, 2023-07-29T16:39:55.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:55.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:55.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:55.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:55.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:55.340 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:55.342 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:55.340+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:55.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:55.442 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:55.441+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:55.524 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:55.524 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:55.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.524 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250732 5.3 5.c2a5db33 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.520867+0000", 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00067281600000000002, 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00068920600000000004, 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250732 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520867+0000", 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520867+0000", 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.528 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520866+0000", 2023-07-29T16:39:55.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520870+0000", 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2350000000000001e-06 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520881+0000", 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1229999999999999e-05 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520888+0000", 2023-07-29T16:39:55.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.148e-06 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250710 5.3 5:ceef1bb5:::benchmark_data_smithi070_97781_object108925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.532 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.514769+0000", 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0067698749999999999, 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0068299839999999999, 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.533 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250710 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514769+0000", 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514769+0000", 2023-07-29T16:39:55.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514769+0000", 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514773+0000", 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7359999999999999e-06 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514781+0000", 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1950000000000003e-06 2023-07-29T16:39:55.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.514787+0000", 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.178e-06 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.515834+0000", 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001046866 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.515910+0000", 2023-07-29T16:39:55.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5728000000000004e-05 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250715 5.3 5:c2586d63:::benchmark_data_smithi070_97781_object108930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.541 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.516608+0000", 2023-07-29T16:39:55.542 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0049309899999999997, 2023-07-29T16:39:55.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0050303220000000003, 2023-07-29T16:39:55.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:55.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.544 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.544 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250715 2023-07-29T16:39:55.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.544 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516608+0000", 2023-07-29T16:39:55.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516608+0000", 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516608+0000", 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516613+0000", 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6749999999999999e-06 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516625+0000", 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2221999999999999e-05 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.516634+0000", 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3000000000000002e-06 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517661+0000", 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00102699 2023-07-29T16:39:55.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517744+0000", 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.3731000000000002e-05 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250717 5.3 5:cb28faa2:::benchmark_data_smithi070_97781_object108932:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.517567+0000", 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0039725849999999998, 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0041086439999999998, 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.551 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250717 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517567+0000", 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.553 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517567+0000", 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517566+0000", 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517570+0000", 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1810000000000003e-06 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517577+0000", 2023-07-29T16:39:55.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.8059999999999997e-06 2023-07-29T16:39:55.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.517582+0000", 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8080000000000004e-06 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519201+0000", 2023-07-29T16:39:55.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0016186939999999999 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519359+0000", 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015811500000000001 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.558 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250724 5.f 5:f8be3d5d:::benchmark_data_smithi070_97781_object108939:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.518455+0000", 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0030845249999999999, 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032584430000000002, 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250724 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518455+0000", 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518455+0000", 2023-07-29T16:39:55.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518454+0000", 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518459+0000", 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9409999999999998e-06 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518470+0000", 2023-07-29T16:39:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0934000000000001e-05 2023-07-29T16:39:55.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518480+0000", 2023-07-29T16:39:55.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0319000000000001e-05 2023-07-29T16:39:55.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.565 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.565 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518520+0000", 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9894000000000001e-05 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518642+0000", 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121604 2023-07-29T16:39:55.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.518750+0000", 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000108705 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250725 5.3 5:c3078d58:::benchmark_data_smithi070_97781_object108940:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.519002+0000", 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00253755, 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027512399999999998, 2023-07-29T16:39:55.568 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250725 2023-07-29T16:39:55.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519002+0000", 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519002+0000", 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519001+0000", 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519005+0000", 2023-07-29T16:39:55.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9539999999999998e-06 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519017+0000", 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1545999999999999e-05 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519023+0000", 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5799999999999997e-06 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.521079+0000", 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020557100000000001 2023-07-29T16:39:55.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.521204+0000", 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012478000000000001 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.575 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250726 5.f 5:f8d17dce:::benchmark_data_smithi070_97781_object108941:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.519776+0000", 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0017635560000000001, 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0020142720000000001, 2023-07-29T16:39:55.576 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250726 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519776+0000", 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519776+0000", 2023-07-29T16:39:55.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519775+0000", 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519779+0000", 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4479999999999999e-06 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519787+0000", 2023-07-29T16:39:55.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1110000000000008e-06 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.519791+0000", 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5290000000000002e-06 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520444+0000", 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00065246900000000003 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520542+0000", 2023-07-29T16:39:55.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7755000000000002e-05 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520613+0000", 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1311999999999998e-05 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.583 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250727 5.9 5:9a28f1dc:::benchmark_data_smithi070_97781_object108942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.520358+0000", 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.001181739, 2023-07-29T16:39:55.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0014759860000000001, 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250727 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.585 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520358+0000", 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520358+0000", 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520357+0000", 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520362+0000", 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7330000000000003e-06 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520370+0000", 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4270000000000008e-06 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520377+0000", 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.708e-06 2023-07-29T16:39:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520498+0000", 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121629 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520610+0000", 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011131700000000001 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520684+0000", 2023-07-29T16:39:55.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.4405000000000003e-05 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:250728 5.f 5.e399b71f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2023-07-29T16:39:55.592 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:55.520530+0000", 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0010092879999999999, 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013415860000000001, 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:55.593 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 250728 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520530+0000", 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520530+0000", 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:55.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520529+0000", 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520534+0000", 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.729e-06 2023-07-29T16:39:55.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520542+0000", 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.2449999999999998e-06 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:55.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:55.520549+0000", 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2729999999999999e-06 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 9 2023-07-29T16:39:55.598 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:55.600 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:55.600 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:55.598+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:55.700 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:55.698+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:55.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:39:55.801 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:55.799+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:55.816 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:55.816 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:55.817 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:55.817 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:55.830 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:55.903 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:55.900+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:55.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:39:56.003 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.001+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:56.014 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:56.014 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:56.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 63.812722110999999, 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:56.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.016 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.016 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:56.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:56.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:56.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.026 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.401925824000003, 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.027 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:56.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:56.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.036 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.399360764999997, 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.037 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:56.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.046 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:56.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.049 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.399060271000003, 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.050 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:56.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.052 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:56.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:56.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:56.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.384270458000003, 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.063 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:56.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.383369582999997, 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.075 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:56.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:56.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:56.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.374519831000001, 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:56.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:56.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:56.098 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.374437978000003, 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.099 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:56.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:56.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:56.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:56.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.108 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:56.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.373526437999999, 2023-07-29T16:39:56.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.111 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:56.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:56.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.118 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.121 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 41.356074169000003, 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.123 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:56.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:56.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:56.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:56.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.748596641999999, 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:56.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.142 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.746161282999999, 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:56.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.144 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:56.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:56.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:56.152 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.746075145999999, 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:56.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:56.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.746020475000002, 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:56.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:56.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:56.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:56.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.745393264, 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.173 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:56.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.182 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.744964288999999, 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.183 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:56.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:56.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:56.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.191 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.743770746999999, 2023-07-29T16:39:56.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.193 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:56.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:56.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.743741370999999, 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:56.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:56.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:56.210 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.743511972, 2023-07-29T16:39:56.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:56.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:56.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:56.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 18.743410687000001, 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:56.223 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:56.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:56.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:56.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:56.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:56.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:56.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:56.232 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:56.232 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:56.233 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.231+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:56.233 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:56.234 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:56.234 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:56.235 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:39:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:39:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:56.236 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:56.334 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.332+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:56.406 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:56.407 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:56.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:56.436 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:56.434+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:56.536 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.534+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:56.631 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:56.632 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:56.637 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:56.635+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:56.644 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:56.698 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:39:56.737 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.736+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:56.839 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:56.837+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:56.852 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:56.853 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:56.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:56.939 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:56.937+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.040 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:57.041 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:57.041 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:57.038+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:57.141 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:57.139+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.231 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:57.231 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:57.242 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:57.240+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:57.245 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:57.343 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:57.341+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.444 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:57.442+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:57.464 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:57.465 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:57.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:57.545 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:57.543+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:57.645 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:57.643+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.647 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:57.647 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:57.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:57.746 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:57.745+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:57.848 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:57.846+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:57.874 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:57.875 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:57.888 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:57.948 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:57.946+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:58.049 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:58.047+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:58.104 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:58.104 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:58.118 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:58.150 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:58.148+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:58.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:39:58.250 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:58.248+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:58.298 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:39:58.298 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:39:58.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:39:58.352 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:58.349+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:58.386 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:39:58.408 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:39:58.409 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:39:58.409 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:39:58.409 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:39:58.411 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:39:58.412 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:39:58.452 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:58.450+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:58.531 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:58.531 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:39:58.532 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:39:58.532 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:39:58.532 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:58.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:39:58.553 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:58.551+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:58.654 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:58.652+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:58.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:39:58.726 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:39:58.726 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:39:58.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:39:58.726 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 66.524145653000005, 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.727 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.729 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:58.729 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.729 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.730 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:39:58.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.730 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:39:58.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:39:58.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:39:58.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:39:58.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:39:58.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:58.739 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.113349366000001, 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:39:58.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:39:58.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:39:58.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:39:58.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:39:58.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.748 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.110784307000003, 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:39:58.749 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:39:58.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:39:58.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:39:58.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:39:58.761 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.110483813000002, 2023-07-29T16:39:58.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.763 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.768 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:39:58.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:39:58.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:39:58.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:39:58.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:39:58.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.775 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.095694000000002, 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:39:58.778 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.779 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:39:58.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:39:58.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:39:58.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:39:58.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.094793125000002, 2023-07-29T16:39:58.788 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.789 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.790 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:39:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:39:58.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.799 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.085943372999999, 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.800 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:58.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:39:58.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:39:58.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.807 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:39:58.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.809 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:39:58.811 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.085861520000002, 2023-07-29T16:39:58.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:39:58.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:39:58.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:39:58.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:39:58.822 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.823 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.084949979999998, 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:39:58.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:39:58.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:39:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:39:58.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:39:58.835 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:58.836 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 44.067497711000001, 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:39:58.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.838 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:39:58.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:39:58.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:39:58.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.847 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.460020184000001, 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.848 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:58.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.851 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:39:58.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.853 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:39:58.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:39:58.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.457584825000001, 2023-07-29T16:39:58.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.858 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:39:58.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:39:58.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:58.866 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.457498688000001, 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:39:58.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.868 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:39:58.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:39:58.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:39:58.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.875 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.457444017, 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.876 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:39:58.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.881 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:39:58.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:39:58.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.456816805999999, 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.886 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:39:58.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:39:58.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:39:58.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.456387831000001, 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.895 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.896 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:39:58.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.455194289000001, 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:39:58.904 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:39:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:39:58.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:39:58.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.911 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:39:58.912 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.455164913000001, 2023-07-29T16:39:58.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.914 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:39:58.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:39:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:39:58.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.454935513999999, 2023-07-29T16:39:58.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.923 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:39:58.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:39:58.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 21.454834228999999, 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:58.933 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:39:58.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:39:58.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:39:58.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:39:58.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.941 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:39:58.942 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:39:58.942 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:39:58.943 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:39:58.945 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:58.943+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:59.043 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:59.042+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:59.126 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:59.126 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:59.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:260505 5.9 e66/19 5:9e7f7195:::benchmark_data_smithi070_97781_object118720:head v 66'16285, mlcod=66'16283)", 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.117920+0000", 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0011178900000000001, 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001141001, 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117920+0000", 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117920+0000", 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117919+0000", 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117925+0000", 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117934+0000", 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1509999999999993e-06 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117941+0000", 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4400000000000002e-06 2023-07-29T16:39:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.117984+0000", 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2852000000000002e-05 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118007+0000", 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3728000000000001e-05 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.133 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260508 5.e 5:74581568:::benchmark_data_smithi070_97781_object118723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.118451+0000", 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00058625599999999995, 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00067574699999999998, 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.134 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260508 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118451+0000", 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118451+0000", 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118450+0000", 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118455+0000", 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9980000000000003e-06 2023-07-29T16:39:59.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118465+0000", 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3570000000000004e-06 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118473+0000", 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9829999999999996e-06 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118525+0000", 2023-07-29T16:39:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2153e-05 2023-07-29T16:39:59.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118661+0000", 2023-07-29T16:39:59.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013579999999999999 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260509 5.e 5.80dc42e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.118485+0000", 2023-07-29T16:39:59.141 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00055227900000000003, 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00070836900000000003, 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260509 2023-07-29T16:39:59.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118485+0000", 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118485+0000", 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118485+0000", 2023-07-29T16:39:59.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118488+0000", 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9560000000000002e-06 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118493+0000", 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7079999999999996e-06 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118496+0000", 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4450000000000001e-06 2023-07-29T16:39:59.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260510 5.0 5:0a68d293:::benchmark_data_smithi070_97781_object118725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.118531+0000", 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00050703399999999996, 2023-07-29T16:39:59.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071833300000000004, 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260510 2023-07-29T16:39:59.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118531+0000", 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118531+0000", 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118530+0000", 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118533+0000", 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6359999999999998e-06 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118540+0000", 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1810000000000004e-06 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118546+0000", 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.852e-06 2023-07-29T16:39:59.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118657+0000", 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011123700000000001 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118769+0000", 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111723 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260490 5.0 5:0d864bc8:::benchmark_data_smithi070_97781_object118705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.112796+0000", 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0062416440000000002, 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065211360000000003, 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260490 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112796+0000", 2023-07-29T16:39:59.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112796+0000", 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112795+0000", 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112800+0000", 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0610000000000003e-06 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112813+0000", 2023-07-29T16:39:59.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2984e-05 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112822+0000", 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4929999999999998e-06 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112864+0000", 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1863000000000002e-05 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.112938+0000", 2023-07-29T16:39:59.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4396999999999999e-05 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:260493 5.f e66/19 5:ffc037c3:::benchmark_data_smithi070_97781_object118708:head v 66'16109, mlcod=66'16107)", 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.114301+0000", 2023-07-29T16:39:59.162 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0047370850000000003, 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050825820000000004, 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114301+0000", 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114301+0000", 2023-07-29T16:39:59.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114300+0000", 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114306+0000", 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.852e-06 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114319+0000", 2023-07-29T16:39:59.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2855e-05 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114326+0000", 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3379999999999999e-06 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114369+0000", 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3049000000000001e-05 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114390+0000", 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.084e-05 2023-07-29T16:39:59.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.169 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.169 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260495 5.0 5:0f9acd85:::benchmark_data_smithi070_97781_object118710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.114535+0000", 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0045027820000000003, 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049076349999999996, 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260495 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114535+0000", 2023-07-29T16:39:59.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114535+0000", 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114534+0000", 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114539+0000", 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6940000000000003e-06 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114550+0000", 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0815000000000001e-05 2023-07-29T16:39:59.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114557+0000", 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.362e-06 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114604+0000", 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7564000000000001e-05 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114735+0000", 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131061 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.176 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260497 5.b 5:d60436d9:::benchmark_data_smithi070_97781_object118712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.114771+0000", 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0042668840000000003, 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047366600000000002, 2023-07-29T16:39:59.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260497 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.178 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114771+0000", 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114771+0000", 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114770+0000", 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114774+0000", 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3250000000000001e-06 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114785+0000", 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0739e-05 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114792+0000", 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4699999999999996e-06 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116410+0000", 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016171919999999999 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116540+0000", 2023-07-29T16:39:59.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130059 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260499 5.8 5:1bd3a33b:::benchmark_data_smithi070_97781_object118714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.114855+0000", 2023-07-29T16:39:59.184 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041824599999999998, 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047195470000000002, 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260499 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114855+0000", 2023-07-29T16:39:59.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114855+0000", 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114855+0000", 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114858+0000", 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5279999999999999e-06 2023-07-29T16:39:59.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114866+0000", 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2239999999999995e-06 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.114873+0000", 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.165e-06 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116415+0000", 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001541337 2023-07-29T16:39:59.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116539+0000", 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012463700000000001 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:260501 5.8 5:1c720be6:::benchmark_data_smithi070_97781_object118716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.115580+0000", 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0034572069999999999, 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040708810000000002, 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.192 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260501 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115580+0000", 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115580+0000", 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115580+0000", 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115584+0000", 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.33e-06 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115593+0000", 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4790000000000002e-06 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115604+0000", 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1029000000000001e-05 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118521+0000", 2023-07-29T16:39:59.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029166090000000001 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.118638+0000", 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116884 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:260494 5.f e66/19 5:f8a63b9e:::benchmark_data_smithi070_97781_object118709:head v 66'16110, mlcod=66'16107)", 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:59.115677+0000", 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0033602469999999998, 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00403959, 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115677+0000", 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115677+0000", 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115677+0000", 2023-07-29T16:39:59.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115682+0000", 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2100000000000001e-06 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115690+0000", 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2709999999999992e-06 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.115696+0000", 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.913e-06 2023-07-29T16:39:59.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116009+0000", 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031314199999999998 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:59.116033+0000", 2023-07-29T16:39:59.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3382000000000001e-05 2023-07-29T16:39:59.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.206 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:39:59.206 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 11 2023-07-29T16:39:59.206 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:59.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:39:59.210 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:59.208+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:39:59.310 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:59.307+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:59.375 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:59.375 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:39:59.375 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:39:59.375 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:39:59.376 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:59.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:39:59.436 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:59.433+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:59.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2023-07-29T16:39:59.513 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:59.510+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:59.606 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:39:59.606 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:39:59.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:39:59.606 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:39:59.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.552105796999996, 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.607 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:39:59.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:39:59.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.617 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.552021967000002, 2023-07-29T16:39:59.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:39:59.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:39:59.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:39:59.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:39:59.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:39:59.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:39:59.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:39:59.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:59.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:59.631 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.549479001999998, 2023-07-29T16:39:59.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:39:59.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:39:59.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:59.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:39:59.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:39:59.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:39:59.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.642 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:59.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.534718956000006, 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:39:59.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:39:59.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:39:59.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.655 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.656 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:59.656 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.507192910000001, 2023-07-29T16:39:59.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:39:59.656 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.656 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.657 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:39:59.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:39:59.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:39:59.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:39:59.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:39:59.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:39:59.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:39:59.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:39:59.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:39:59.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:39:59.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:39:59.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.673 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.673 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:59.673 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.507033105999994, 2023-07-29T16:39:59.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:39:59.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.674 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:39:59.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:39:59.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:39:59.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:39:59.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:39:59.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:39:59.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:39:59.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:39:59.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:39:59.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:39:59.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:39:59.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:39:59.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:39:59.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:39:59.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.502905953999999, 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:39:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:59.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:39:59.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:39:59.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:39:59.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:39:59.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:39:59.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:39:59.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:39:59.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:39:59.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:39:59.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:39:59.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:39:59.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:39:59.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:39:59.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:39:59.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:39:59.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:39:59.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:39:59.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:39:59.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:39:59.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:39:59.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:39:59.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:39:59.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.706 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.707 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.707 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:59.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.497259149000001, 2023-07-29T16:39:59.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:39:59.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.709 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:59.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:39:59.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:39:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.452269856000001, 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:39:59.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.721 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:39:59.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:39:59.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:39:59.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:39:59.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:39:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.732 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.395186949000006, 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:39:59.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:39:59.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:39:59.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:39:59.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:39:59.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:39:59.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:39:59.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.395112866000005, 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:39:59.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:59.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:59.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:39:59.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:39:59.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:39:59.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:39:59.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:39:59.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:39:59.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:39:59.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:39:59.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:39:59.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:39:59.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:39:59.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.761 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.761 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.394914451000005, 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:39:59.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:39:59.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:39:59.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:39:59.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:39:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:39:59.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:39:59.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:59.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.394533132000007, 2023-07-29T16:39:59.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:39:59.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.776 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.776 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.776 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:39:59.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.777 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:59.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:39:59.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:39:59.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:39:59.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:39:59.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:39:59.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:39:59.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:39:59.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:39:59.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:39:59.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.393140009000007, 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:59.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:39:59.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:39:59.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:39:59.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:39:59.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:39:59.801 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.917944181000003, 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:59.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:39:59.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:39:59.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:39:59.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.357646420999998, 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:39:59.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:39:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:39:59.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:39:59.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:59.822 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.977993198999997, 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:59.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:39:59.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:39:59.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:39:59.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:59.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.289440032999998, 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:39:59.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:39:59.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:39:59.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:39:59.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.843 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.284545551999997, 2023-07-29T16:39:59.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:39:59.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:39:59.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:39:59.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.854 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.282877806000002, 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:39:59.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:39:59.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:59.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:39:59.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:39:59.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:39:59.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:39:59.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:39:59.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:39:59.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:39:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:39:59.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:39:59.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:39:59.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:39:59.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:39:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:39:59.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:39:59.866 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:59.662+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:59.867 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:39:59.868 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:39:59.865+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:39:59.969 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:39:59.967+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:00.052 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:00.052 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263082 5.3 5.e91c6243 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.043853+0000", 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00076493899999999996, 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00078015699999999996, 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.053 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "queued for pg", 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263082 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043853+0000", 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.055 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043853+0000", 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043853+0000", 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043855+0000", 2023-07-29T16:40:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.52e-06 2023-07-29T16:40:00.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043861+0000", 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0809999999999999e-06 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043868+0000", 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9750000000000001e-06 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263083 5.2 5:444af4e1:::benchmark_data_smithi070_97781_object121298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.043873+0000", 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00074512199999999997, 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00080039900000000003, 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.060 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263083 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.061 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043873+0000", 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043873+0000", 2023-07-29T16:40:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043872+0000", 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043875+0000", 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0820000000000001e-06 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043882+0000", 2023-07-29T16:40:00.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.041e-06 2023-07-29T16:40:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043888+0000", 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0599999999999996e-06 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043913+0000", 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5748000000000001e-05 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043986+0000", 2023-07-29T16:40:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2523999999999999e-05 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263084 5.6 5:6b8800a2:::benchmark_data_smithi070_97781_object121299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.043895+0000", 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00072285600000000002, 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00081665399999999999, 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263084 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043895+0000", 2023-07-29T16:40:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043895+0000", 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043895+0000", 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043897+0000", 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.0619999999999999e-06 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043902+0000", 2023-07-29T16:40:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7039999999999999e-06 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043907+0000", 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.3760000000000001e-06 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043945+0000", 2023-07-29T16:40:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7737999999999997e-05 2023-07-29T16:40:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.044073+0000", 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012871099999999999 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263075 5.f 5:fcf0d1e8:::benchmark_data_smithi070_97781_object121290:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.039351+0000", 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0052667310000000002, 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0054030019999999996, 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263075 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039351+0000", 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039351+0000", 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039351+0000", 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039354+0000", 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8369999999999999e-06 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039362+0000", 2023-07-29T16:40:00.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3379999999999999e-06 2023-07-29T16:40:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.083 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039366+0000", 2023-07-29T16:40:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0949999999999998e-06 2023-07-29T16:40:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039412+0000", 2023-07-29T16:40:00.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6485e-05 2023-07-29T16:40:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.086 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039562+0000", 2023-07-29T16:40:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015008099999999999 2023-07-29T16:40:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.087 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.039701+0000", 2023-07-29T16:40:00.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013813000000000001 2023-07-29T16:40:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043693+0000", 2023-07-29T16:40:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039927010000000004 2023-07-29T16:40:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.090 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.091 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263076 5.3 5:cc50bd3e:::benchmark_data_smithi070_97781_object121291:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.040888+0000", 2023-07-29T16:40:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0037294300000000002, 2023-07-29T16:40:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039496160000000004, 2023-07-29T16:40:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263076 2023-07-29T16:40:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.094 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040888+0000", 2023-07-29T16:40:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.096 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040888+0000", 2023-07-29T16:40:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.097 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040888+0000", 2023-07-29T16:40:00.098 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040892+0000", 2023-07-29T16:40:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.799e-06 2023-07-29T16:40:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040901+0000", 2023-07-29T16:40:00.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0319999999999992e-06 2023-07-29T16:40:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040906+0000", 2023-07-29T16:40:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7930000000000003e-06 2023-07-29T16:40:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040941+0000", 2023-07-29T16:40:00.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4660999999999999e-05 2023-07-29T16:40:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041037+0000", 2023-07-29T16:40:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5704000000000004e-05 2023-07-29T16:40:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.106 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.107 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263077 5.3 5:c75eedb8:::benchmark_data_smithi070_97781_object121292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.040918+0000", 2023-07-29T16:40:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003699473, 2023-07-29T16:40:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0039929529999999996, 2023-07-29T16:40:00.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263077 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040918+0000", 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040918+0000", 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040918+0000", 2023-07-29T16:40:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040920+0000", 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9420000000000002e-06 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040924+0000", 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9210000000000002e-06 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.040927+0000", 2023-07-29T16:40:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0419999999999998e-06 2023-07-29T16:40:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.042807+0000", 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018796290000000001 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.042900+0000", 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3400999999999996e-05 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263079 5.f 5:f44e57db:::benchmark_data_smithi070_97781_object121294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.041851+0000", 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0027667529999999998, 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0031091959999999998, 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.117 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263079 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041851+0000", 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.119 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041851+0000", 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041851+0000", 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041853+0000", 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6989999999999999e-06 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041860+0000", 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7290000000000003e-06 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041864+0000", 2023-07-29T16:40:00.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8299999999999998e-06 2023-07-29T16:40:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.041899+0000", 2023-07-29T16:40:00.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4619999999999997e-05 2023-07-29T16:40:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.042028+0000", 2023-07-29T16:40:00.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012925 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.042154+0000", 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012581699999999999 2023-07-29T16:40:00.126 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:263081 5.3 5:c4fa15c5:::benchmark_data_smithi070_97781_object121296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2023-07-29T16:40:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:00.043818+0000", 2023-07-29T16:40:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.00079957800000000001, 2023-07-29T16:40:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.001213715, 2023-07-29T16:40:00.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 263081 2023-07-29T16:40:00.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043818+0000", 2023-07-29T16:40:00.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043818+0000", 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043817+0000", 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043823+0000", 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2079999999999999e-06 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043835+0000", 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.2119999999999999e-05 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.043844+0000", 2023-07-29T16:40:00.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.0000000000000002e-06 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.044072+0000", 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000228104 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:00.044183+0000", 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00011161400000000001 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:40:00.137 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 8 2023-07-29T16:40:00.137 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:00.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:00.138 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:00.122+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:00.226 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:00.224+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:00.326 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:00.324+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:00.345 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:00.345 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:00.346 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:40:00.346 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:40:00.346 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:00.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:00.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:40:00.429 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:00.427+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:00.530 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:00.527+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:00.541 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:00.541 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:00.541 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:00.541 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 68.339206806999997, 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.542 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:00.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:00.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:00.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:00.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:00.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:00.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.92841052, 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:00.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:00.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:00.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:00.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:00.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:00.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:00.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.564 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.565 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.565 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:00.565 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.925845461000002, 2023-07-29T16:40:00.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:00.565 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.566 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:00.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:00.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:00.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:00.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:00.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:00.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:00.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:00.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:00.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:00.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:00.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:00.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:00.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.581 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.925544967, 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.582 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:00.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:00.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:00.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:00.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:00.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.910755154, 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.596 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:00.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.601 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:00.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:00.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:00.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.909854279000001, 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:00.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:00.612 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.613 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:00.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:00.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:00.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:00.619 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.901004526999998, 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:00.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.625 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:00.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:00.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.632 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.900922674, 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.633 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.634 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.900011134000003, 2023-07-29T16:40:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:00.647 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.647 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.647 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.648 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.649 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:00.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.649 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:00.651 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.651 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.652 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:00.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.652 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.652 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:00.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:00.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:00.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:00.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:00.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.662 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:00.663 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:00.664 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 45.882558865, 2023-07-29T16:40:00.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:00.664 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.664 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.665 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:00.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:00.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:00.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:00.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:00.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.671 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:00.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.275081338, 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.677 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.680 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:00.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:00.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:00.685 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:00.686 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.272645979, 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.687 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.689 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:00.690 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:00.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:00.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:00.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:00.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:00.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:00.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:00.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:00.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:00.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.698 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.272559842, 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:00.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:00.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:00.707 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:00.708 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.272505170999999, 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.709 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:00.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:00.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.718 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.719 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.271877960000001, 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.720 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:00.721 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.722 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:00.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.724 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:00.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.728 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.729 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.729 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:00.729 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.271448984999999, 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.730 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.731 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.732 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.733 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.734 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.736 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:00.737 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.738 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.270255443, 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.739 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.740 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:00.741 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.742 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:00.743 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.744 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:00.745 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.746 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:00.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:00.748 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.270226066999999, 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.749 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:00.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:00.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:00.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.269996668000001, 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.758 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:00.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:00.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:00.765 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:00.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 23.269895383000001, 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:00.769 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:00.770 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.771 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:00.772 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.773 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:00.774 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.775 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:00.776 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.777 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.778 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:00.778 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:00.778 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:00.779 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:00.781 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:00.777+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:00.781 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:00.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:00.782 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:40:00.782 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:40:00.782 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:00.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:00.883 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:00.880+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:00.956 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:00.957 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:00.972 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:00.982 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:00.979+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:01.082 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:01.080+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:01.184 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:01.181+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:01.186 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:01.186 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:01.202 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:01.286 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:01.283+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:01.380 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:01.381 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:01.387 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:01.385+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:01.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:01.486 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:01.484+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:01.573 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:01.573 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:01.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:01.588 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:01.586+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:01.688 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:01.685+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:01.776 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:01.776 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:01.792 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:01.793 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:01.789+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:01.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:40:01.890 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:01.888+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:01.991 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:01.988+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:02.013 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.014 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:02.092 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:02.089+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:02.193 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.190+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.197 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.198 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:02.296 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.294+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.394 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.392+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.416 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.417 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:02.495 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:02.492+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:02.619 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.620 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:02.714 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:40:02.757 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.757 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:02.779 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.594+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.779 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.774+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:40:02.797 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.795+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.898 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.896+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:02.932 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:02.947 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:02.956 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:40:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:40:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:02.959 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:02.960 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:02.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:02.999 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:02.997+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.101 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:03.099+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.149 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 70.947638253999997, 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.151 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:03.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:03.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:03.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:03.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.536841967000001, 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.161 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:03.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:03.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:03.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.534276908000002, 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.171 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.174 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:03.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:03.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:03.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.533976414000001, 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.184 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:03.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:03.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.519186601000001, 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:03.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:03.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:03.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:03.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.518285726000002, 2023-07-29T16:40:03.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:03.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.219 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.509435973999999, 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:03.220 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:03.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:03.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:03.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:03.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.509354121000001, 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.232 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:03.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:03.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:03.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:03.243 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.508442580999997, 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:03.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:03.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:03.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 48.490990312000001, 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:03.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:03.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:03.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:03.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:03.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.266 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.883512785000001, 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.267 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:03.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:03.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.881077426000001, 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.276 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:03.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:03.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:03.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.880991289000001, 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.285 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:03.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:03.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:03.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.293 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.294 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.294 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:03.294 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.880936618, 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.295 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:03.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.304 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.880309406999999, 2023-07-29T16:40:03.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.306 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:03.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:03.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.879880432, 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:03.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:03.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:03.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:03.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.323 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.878686890000001, 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.324 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:03.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:03.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.332 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.878657514, 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.333 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:03.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:03.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:03.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.878428114999998, 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:03.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:03.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:03.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:03.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:03.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 25.878326829999999, 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:03.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:03.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:03.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:03.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:03.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:03.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:03.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.361 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.361 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.361 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:03.361 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:03.361 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:03.362 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:03.359+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:03.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:03.464 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:03.462+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.528 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:272122 5.a 5:597722e1:::benchmark_data_smithi070_97781_object130337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.521544+0000", 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0049023620000000004, 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004922437, 2023-07-29T16:40:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 272122 2023-07-29T16:40:03.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521544+0000", 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521544+0000", 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521544+0000", 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521548+0000", 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8330000000000004e-06 2023-07-29T16:40:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521556+0000", 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3110000000000006e-06 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521562+0000", 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2920000000000001e-06 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521593+0000", 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0874999999999998e-05 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521684+0000", 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1279999999999993e-05 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:272124 5.a 5:5c2a84c6:::benchmark_data_smithi070_97781_object130339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.521867+0000", 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0045802280000000004, 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046484270000000001, 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 272124 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521867+0000", 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521867+0000", 2023-07-29T16:40:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521866+0000", 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521870+0000", 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6299999999999997e-06 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521882+0000", 2023-07-29T16:40:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1262e-05 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.521890+0000", 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4919999999999993e-06 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522824+0000", 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00093374500000000004 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522917+0000", 2023-07-29T16:40:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3319999999999994e-05 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:272125 5.d e68/51 5:be8946c2:::benchmark_data_smithi070_97781_object130340:head v 68'17014, mlcod=68'17011)", 2023-07-29T16:40:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.522500+0000", 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00394686, 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040556339999999998, 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522500+0000", 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522500+0000", 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522499+0000", 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522504+0000", 2023-07-29T16:40:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.062e-06 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522514+0000", 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9559999999999992e-06 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522520+0000", 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7350000000000001e-06 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522560+0000", 2023-07-29T16:40:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000002e-05 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.522583+0000", 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3529000000000001e-05 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:272133 5.e 5:73e56388:::benchmark_data_smithi070_97781_object130348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.524198+0000", 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0022492530000000001, 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002416526, 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 272133 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524198+0000", 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524198+0000", 2023-07-29T16:40:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524197+0000", 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524203+0000", 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0039999999999996e-06 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524212+0000", 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9530000000000005e-06 2023-07-29T16:40:03.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524218+0000", 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6109999999999999e-06 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524260+0000", 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1411e-05 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524391+0000", 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013086700000000001 2023-07-29T16:40:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:272131 5.f e68/19 5:f61f8e0c:::benchmark_data_smithi070_97781_object130346:head v 68'16831, mlcod=68'16829)", 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.524504+0000", 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001943043, 2023-07-29T16:40:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021587469999999999, 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524504+0000", 2023-07-29T16:40:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524504+0000", 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524503+0000", 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524507+0000", 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5030000000000002e-06 2023-07-29T16:40:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524514+0000", 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.289e-06 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524518+0000", 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8940000000000003e-06 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524549+0000", 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0766000000000003e-05 2023-07-29T16:40:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.524562+0000", 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3056e-05 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:272135 5.9 e68/19 5:9f281cf1:::benchmark_data_smithi070_97781_object130350:head v 68'16994, mlcod=68'16992)", 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.526070+0000", 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000376411, 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062493200000000003, 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526070+0000", 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526070+0000", 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526070+0000", 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526078+0000", 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6529999999999994e-06 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526085+0000", 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7309999999999993e-06 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526090+0000", 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9729999999999997e-06 2023-07-29T16:40:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526118+0000", 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8078000000000001e-05 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526132+0000", 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.345e-05 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4749.0:272129 5.d e68/51 5:b8e5917a:::benchmark_data_smithi070_97781_object130344:head v 68'17015, mlcod=68'17011)", 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:40:03.526541+0000", 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9999056, 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018694800000000001, 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526541+0000", 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526541+0000", 2023-07-29T16:40:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526540+0000", 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526544+0000", 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8419999999999998e-06 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526551+0000", 2023-07-29T16:40:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7460000000000003e-06 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526555+0000", 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5829999999999998e-06 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526587+0000", 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2237000000000003e-05 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:40:03.526605+0000", 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8468999999999999e-05 2023-07-29T16:40:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 7 2023-07-29T16:40:03.578 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:03.580 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:03.580 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:03.577+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.680 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:03.678+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.781 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:03.779+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:03.789 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:03.790 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:03.790 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:40:03.790 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:40:03.790 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:03.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:03.883 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:03.880+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:03.984 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:03.981+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:04.014 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:04.014 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.960045952000002, 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:40:04.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:40:04.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:40:04.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:40:04.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:40:04.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:40:04.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:04.027 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.959962121999993, 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.028 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:40:04.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:40:04.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:40:04.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.957419157000004, 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.039 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:40:04.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:40:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:40:04.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.942659110999998, 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.051 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:40:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:40:04.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:40:04.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:40:04.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.061 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.915133065000006, 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:40:04.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:40:04.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:40:04.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:40:04.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:04.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.914973261, 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:40:04.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:40:04.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:40:04.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.910846109000005, 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:40:04.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:40:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:40:04.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.905199304000007, 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:40:04.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.097 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:40:04.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:40:04.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:40:04.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:04.107 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.860210011000007, 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.108 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:40:04.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:40:04.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:40:04.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.803127103999998, 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:40:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:40:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:40:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.803053020999997, 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:40:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:40:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:40:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.802854605999997, 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:40:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:40:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:40:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.802473286999998, 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:40:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:40:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:40:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.801080163999998, 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:40:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:40:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:40:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.325884336000001, 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:40:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:40:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:40:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.765586575999997, 2023-07-29T16:40:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:40:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:40:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:40:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.385933354000002, 2023-07-29T16:40:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:40:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:40:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:40:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:40:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.697380187999997, 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:40:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:40:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:40:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.692485707000003, 2023-07-29T16:40:04.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:40:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:40:04.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:40:04.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:40:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.690817961, 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:40:04.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:40:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:04.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:40:04.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:40:04.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:40:04.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.235 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:04.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:04.236 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:04.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:04.238 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:04.235+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:04.338 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:04.335+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:04.411 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:04.411 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274535 5.1 5:833098d1:::benchmark_data_smithi070_97781_object132750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.406283+0000", 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0022975719999999999, 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0023246500000000002, 2023-07-29T16:40:04.412 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274535 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.413 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406283+0000", 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.414 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406283+0000", 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406282+0000", 2023-07-29T16:40:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406286+0000", 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.783e-06 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.416 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406293+0000", 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.1459999999999999e-06 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406310+0000", 2023-07-29T16:40:04.417 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.7212000000000001e-05 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.407678+0000", 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0013676820000000001 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.418 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.407759+0000", 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.1557999999999994e-05 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.419 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274524 5.2 5:4af315c6:::benchmark_data_smithi070_97781_object132739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.420 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.405168+0000", 2023-07-29T16:40:04.420 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.003412024, 2023-07-29T16:40:04.420 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035202599999999999, 2023-07-29T16:40:04.420 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.420 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274524 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.421 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.422 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.422 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405168+0000", 2023-07-29T16:40:04.422 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.422 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405168+0000", 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.423 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405167+0000", 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405172+0000", 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8520000000000003e-06 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.424 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405184+0000", 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.216e-05 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.425 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405191+0000", 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2470000000000002e-06 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405231+0000", 2023-07-29T16:40:04.426 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9072000000000001e-05 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405380+0000", 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000148951 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.427 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274527 5.d 5:bd7196fe:::benchmark_data_smithi070_97781_object132742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.405803+0000", 2023-07-29T16:40:04.428 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0027767619999999999, 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0029541260000000001, 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274527 2023-07-29T16:40:04.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405803+0000", 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405803+0000", 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.431 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.432 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405803+0000", 2023-07-29T16:40:04.432 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.432 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.432 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405808+0000", 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0130000000000001e-06 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.433 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405818+0000", 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0236e-05 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405825+0000", 2023-07-29T16:40:04.434 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9820000000000002e-06 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.405872+0000", 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7593000000000003e-05 2023-07-29T16:40:04.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406007+0000", 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000134752 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.436 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406125+0000", 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000117507 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.437 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274528 5.9 5:93291a9e:::benchmark_data_smithi070_97781_object132743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.406016+0000", 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0025637640000000001, 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0028150829999999999, 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.438 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274528 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.439 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406016+0000", 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406016+0000", 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406016+0000", 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.441 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406020+0000", 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8380000000000004e-06 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406025+0000", 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:40:04.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406029+0000", 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2939999999999999e-06 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.443 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406059+0000", 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9366e-05 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406170+0000", 2023-07-29T16:40:04.444 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000111211 2023-07-29T16:40:04.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.445 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.445 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.445 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406263+0000", 2023-07-29T16:40:04.445 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3423000000000003e-05 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274529 5.9 5:9f4ff247:::benchmark_data_smithi070_97781_object132744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.406158+0000", 2023-07-29T16:40:04.446 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0024218989999999999, 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.002750799, 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "waiting for sub ops", 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.447 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274529 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406158+0000", 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406158+0000", 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.449 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406157+0000", 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406162+0000", 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0990000000000001e-06 2023-07-29T16:40:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406169+0000", 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5229999999999998e-06 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.451 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406175+0000", 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5010000000000004e-06 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.452 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.407704+0000", 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015292109999999999 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.407793+0000", 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.9722999999999995e-05 2023-07-29T16:40:04.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.407857+0000", 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3960000000000004e-05 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.454 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:274533 5.5 5:aaa1667d:::benchmark_data_smithi070_97781_object132748:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:40:04.406189+0000", 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 0.0023913160000000001, 2023-07-29T16:40:04.455 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027935070000000002, 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "started", 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.456 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 274533 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406189+0000", 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.458 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.458 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406189+0000", 2023-07-29T16:40:04.458 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406188+0000", 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.459 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406191+0000", 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0960000000000001e-06 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.460 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406197+0000", 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5450000000000003e-06 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.406200+0000", 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.326e-06 2023-07-29T16:40:04.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.408059+0000", 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0018592120000000001 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.462 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:40:04.408190+0000", 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000130679 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2023-07-29T16:40:04.463 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 6 2023-07-29T16:40:04.464 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:04.465 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:04.462+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:04.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:04.566 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:04.563+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:04.672 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:04.669+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:04.689 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:04.689 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:04.689 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:40:04.689 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:40:04.690 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:04.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:04.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-07-29T16:40:04.787 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:04.784+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:04.869 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:04.867+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:04.926 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:04.927 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 72.725539304999998, 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.928 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:04.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:04.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:04.938 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.314743018000001, 2023-07-29T16:40:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:04.940 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:04.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:04.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.312177959000003, 2023-07-29T16:40:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:04.951 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:04.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:04.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:04.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:04.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:04.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:04.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:04.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:04.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:04.966 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.311877465000002, 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.967 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:04.968 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.969 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.970 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:04.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:04.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:04.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:04.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.980 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.297087652000002, 2023-07-29T16:40:04.981 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:04.982 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:04.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:04.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:04.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:04.991 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:04.992 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:04.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:04.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:04.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:04.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:04.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:04.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.296186777000003, 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.000 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.004 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:05.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:05.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:05.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:05.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:05.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:05.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:05.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:05.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:05.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:05.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:05.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:05.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.014 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:05.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:05.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.015 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.016 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:05.016 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:05.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:05.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:05.018 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.287337024999999, 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.019 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:05.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:05.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:05.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:05.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:05.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:05.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:05.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.027 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.027 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:05.028 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:05.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.029 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.029 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:05.029 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:05.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.030 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:05.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.033 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:05.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.287255172000002, 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:05.036 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.037 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.037 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:05.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.038 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.038 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.038 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.039 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:05.039 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.039 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.040 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.040 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:05.040 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.041 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.041 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.041 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:05.041 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.042 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.042 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.042 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:05.042 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:05.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.043 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.043 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:05.044 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:05.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.044 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.044 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:05.045 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:05.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.045 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.045 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.046 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:05.046 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:05.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.046 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.047 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:05.047 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:05.047 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:05.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.048 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.048 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.048 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:05.048 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:05.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.049 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.049 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:05.050 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:05.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.050 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.050 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.050 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:05.051 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:05.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.051 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.052 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:05.052 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:05.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.052 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.053 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:05.054 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:05.055 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.286343631999998, 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.056 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:05.057 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.059 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:05.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.061 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.062 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:05.062 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:05.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.062 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.063 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.064 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:05.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.066 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:05.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:05.069 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 50.268891363000002, 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.070 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:05.071 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.073 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.073 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.073 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:05.073 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.074 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.075 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:05.076 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.077 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.078 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:05.079 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:05.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.079 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.079 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.080 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:05.080 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:05.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.081 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.081 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.081 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:05.082 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:05.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.082 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.082 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.083 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:05.083 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:05.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.084 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.084 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.084 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:05.084 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.085 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.661413836000001, 2023-07-29T16:40:05.086 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:05.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.089 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:05.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.091 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:05.092 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.094 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.094 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:05.094 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:05.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.094 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.095 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.658978477000002, 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:05.099 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.101 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.102 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:05.103 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:05.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.104 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.104 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:05.104 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:05.105 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:05.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.107 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.658892340000001, 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:05.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.109 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.110 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:05.111 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.112 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.113 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:05.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.115 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.116 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:05.116 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:05.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.117 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.118 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.658837669, 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.119 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.120 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:05.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:05.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:05.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.130 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.658210457999999, 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.131 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.134 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:05.135 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:05.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:05.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:05.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.140 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.657781483000001, 2023-07-29T16:40:05.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:05.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:05.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:05.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:05.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:05.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.656587941000002, 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.152 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:05.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:05.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.158 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.159 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:05.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:05.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.159 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.656558565000001, 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.656329165999999, 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:05.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:40:05.183 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:05.180+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 27.656227881, 2023-07-29T16:40:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:05.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:05.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:05.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:05.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:05.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:05.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:05.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:05.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:05.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:05.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:05.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:05.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:05.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:05.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:05.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:05.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:05.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:05.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:05.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:05.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:05.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:05.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:05.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:05.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:05.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:05.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:05.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:05.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:05.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.219 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:05.220 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:05.220 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:05.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:05.284 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:05.282+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:05.331 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:05.353 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:40:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:40:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:05.355 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:05.356 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:05.384 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:05.382+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:05.395 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:05.395 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:05.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:05.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~72s 2023-07-29T16:40:05.486 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:05.482+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:05.586 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:05.584+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:05.614 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:05.614 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:05.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:05.687 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:05.685+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:05.719 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2023-07-29T16:40:05.788 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:05.785+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:05.798 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:05.798 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:05.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:05.889 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:05.887+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:05.987 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:05.988 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:05.990 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:05.987+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:06.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:06.090 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:06.087+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:06.190 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.188+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.221 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:06.221 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:06.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:06.291 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.289+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.391 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:06.389+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:06.456 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:06.456 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:06.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:06.519 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.517+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.594 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.592+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.647 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:06.647 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:06.659 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:06.695 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:06.692+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:06.796 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.794+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.865 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:06.865 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:06.878 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:06.919 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.917+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:06.998 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:06.996+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:07.090 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:07.091 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:07.099 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.096+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:07.200 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.197+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.288 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:07.288 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:07.300 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.297+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:07.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:40:07.402 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.399+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.502 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.499+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:07.518 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:07.519 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:07.530 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:07.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:40:07.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:40:07.531 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:07.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:07.534 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:07.535 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:07.603 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:07.601+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:07.704 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:07.701+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:07.718 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Removed 141782 objects 2023-07-29T16:40:07.718 INFO:tasks.radosbench.radosbench.0.smithi070.stdout:Clean up completed and total clean up time :50.6305 2023-07-29T16:40:07.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:40:07.747 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:07.747 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:07.747 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:07.747 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:07.747 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 75.545653223000002, 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.748 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.750 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:07.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.752 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.752 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.752 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:07.752 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:07.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.753 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.754 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:07.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.756 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.756 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:07.756 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:07.756 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:07.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.757 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.758 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.758 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:07.758 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:07.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.759 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.759 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.759 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:07.760 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:07.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.760 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.761 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.761 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:07.761 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:07.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.762 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.762 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.763 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.763 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.763 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:07.764 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.134856935999998, 2023-07-29T16:40:07.764 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:07.764 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.764 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:07.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.765 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.766 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:07.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.766 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.767 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.767 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.767 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:07.767 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.768 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.769 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.769 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:07.769 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.770 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.770 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.771 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:07.771 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.772 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.772 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.773 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:07.773 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:07.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.774 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.774 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.775 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:07.775 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:07.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.776 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.776 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.777 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:07.777 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:07.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.778 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.778 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.779 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:07.779 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:07.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.780 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.780 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:07.781 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:07.781 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:07.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.782 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.782 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.782 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:07.783 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:07.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.783 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.783 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.784 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:07.784 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:07.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.785 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.785 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:07.785 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:07.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.786 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.786 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.787 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:07.787 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:07.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.788 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.788 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.789 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.789 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:07.789 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.132291877, 2023-07-29T16:40:07.789 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:07.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.791 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.792 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.793 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:07.794 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:07.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.794 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.794 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.794 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:07.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.797 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:07.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.799 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.799 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.799 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:07.799 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.801 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.801 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.801 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:07.801 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:07.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.802 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.802 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.802 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:07.802 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:07.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.803 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.803 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.804 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:07.804 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:07.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.806 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.806 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.806 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:07.806 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:07.806 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.807 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.807 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.807 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.807 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.808 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:07.808 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.131991382999999, 2023-07-29T16:40:07.808 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:07.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:07.811 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.812 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.813 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.814 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.815 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:07.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:07.818 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.820 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:07.821 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:07.822 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.117201569999999, 2023-07-29T16:40:07.823 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:07.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.823 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.823 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.824 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.825 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:07.826 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:07.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.827 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.827 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.827 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:07.827 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:07.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.829 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.830 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.830 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:07.830 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:07.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.830 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.831 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.831 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:07.831 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:07.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.831 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.832 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.833 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:07.833 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:07.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.833 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.833 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.835 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:07.836 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:07.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.836 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.836 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.836 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:07.837 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.116300695, 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.843 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.844 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.846 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:07.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.849 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.850 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:07.851 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:07.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.851 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.851 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.107450943000003, 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:07.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.853 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.854 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.855 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:07.856 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.856 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.856 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:07.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.858 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.858 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.858 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:07.858 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:07.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.860 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.860 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.860 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:07.860 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:07.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.861 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.861 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.861 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:07.861 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:07.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.863 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.863 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.863 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:07.863 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:07.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.864 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.865 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:07.866 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.107369089999999, 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.868 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:07.869 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.870 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.871 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:07.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.873 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:07.874 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.875 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.876 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:07.877 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:07.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.880 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.881 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.881 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:07.881 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.106457550000002, 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.882 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.883 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:07.884 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.884 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.884 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.884 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:07.885 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.885 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.885 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:07.886 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:07.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.887 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.887 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:07.887 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:07.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.888 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.888 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.888 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:07.888 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:07.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.891 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:07.892 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:07.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.894 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:07.895 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:07.896 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 53.089005280999999, 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.897 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:07.898 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.899 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.900 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:07.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.902 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:07.903 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:07.904 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.907 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:07.908 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:07.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.908 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.908 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:07.909 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.910 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.481527753999998, 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.911 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.912 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:07.913 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.914 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.914 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:07.914 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.915 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.915 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:07.915 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:07.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.916 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.916 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:07.916 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:07.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:07.919 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:07.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.479092394999999, 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.923 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.924 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:07.927 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.928 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.929 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.930 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.931 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.479006257999998, 2023-07-29T16:40:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.933 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:07.935 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.936 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.937 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.937 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:07.937 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:07.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.938 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.938 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.938 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:07.938 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:07.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.939 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.940 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.940 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:07.940 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:07.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.942 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.942 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:07.942 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:07.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.942 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.943 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.944 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.945 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.945 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:07.945 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.478951587000001, 2023-07-29T16:40:07.945 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:07.945 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.946 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.947 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.948 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:07.949 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.950 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:07.951 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:07.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.478324376, 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.477895401000001, 2023-07-29T16:40:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.476701858999999, 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.476672483000002, 2023-07-29T16:40:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.000 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:08.001 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.002 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.476443084, 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:08.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.004 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.005 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:08.006 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.007 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.008 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:08.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.010 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:08.011 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:08.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.012 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:08.012 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:08.012 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:08.014 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 30.476341799, 2023-07-29T16:40:08.015 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:08.017 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:08.018 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:08.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.018 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:08.018 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:08.019 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.020 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:08.020 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:08.020 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:08.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.022 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:08.023 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:08.024 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:08.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.026 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:08.027 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.027 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:08.027 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:08.027 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:08.028 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:08.029 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:08.026+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:08.129 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.126+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.156 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:08.156 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:08.157 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:40:08.157 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:08.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:08.230 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.227+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.291 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:40:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:40:08.292 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:08.301 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:08.331 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.328+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.429 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:08.429 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:40:08.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:40:08.430 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:40:08.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.430 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.375002949999995, 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.431 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:40:08.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:40:08.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:40:08.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.374919120000001, 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:40:08.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:40:08.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:40:08.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:40:08.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:40:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:40:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:40:08.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:08.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.457 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.457 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:08.457 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.372376154999998, 2023-07-29T16:40:08.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:40:08.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.458 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.458 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:08.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:08.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:40:08.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:40:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.357616109000006, 2023-07-29T16:40:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:40:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:40:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:40:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:40:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:40:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:40:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:40:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:40:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.330090063, 2023-07-29T16:40:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:40:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:40:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:40:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:40:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:40:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.329930258999994, 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:40:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:40:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:40:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:40:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.325803106999999, 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:40:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:40:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:40:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:40:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:40:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:40:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:40:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:40:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.320156302000001, 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:40:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:40:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:40:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:40:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:40:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:40:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.275167009, 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:40:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:40:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:40:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:40:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:40:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:40:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:40:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:40:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:40:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.218084102000006, 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:40:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:40:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:40:08.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.559 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.559 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.559 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.218010019000005, 2023-07-29T16:40:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:40:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.560 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:40:08.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:40:08.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:40:08.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:40:08.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:40:08.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:40:08.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:40:08.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:40:08.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:40:08.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:40:08.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:40:08.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:40:08.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.574 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.575 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:08.575 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.217811604000005, 2023-07-29T16:40:08.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:40:08.575 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.575 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.576 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:40:08.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:08.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:40:08.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:40:08.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:40:08.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.217430285000006, 2023-07-29T16:40:08.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:40:08.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:40:08.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:40:08.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:40:08.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:40:08.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:40:08.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:40:08.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:40:08.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.600 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:08.600 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:08.601 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.216037162000006, 2023-07-29T16:40:08.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:40:08.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:08.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:08.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:40:08.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:40:08.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:08.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:40:08.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.740841333999995, 2023-07-29T16:40:08.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:40:08.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:40:08.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:40:08.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:40:08.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:40:08.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:40:08.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:40:08.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:40:08.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:40:08.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.623 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.624 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:40:08.624 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.180543573999998, 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:08.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:40:08.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:40:08.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:40:08.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:40:08.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:40:08.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:40:08.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:40:08.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:40:08.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.635 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.800890352000003, 2023-07-29T16:40:08.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:40:08.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:40:08.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:40:08.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:40:08.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.112337185999998, 2023-07-29T16:40:08.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:40:08.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:40:08.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:40:08.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:40:08.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:40:08.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:40:08.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:40:08.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:40:08.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:40:08.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:40:08.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:40:08.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:40:08.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:08.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.658 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:08.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:08.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.107442704999997, 2023-07-29T16:40:08.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:40:08.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:40:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:40:08.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.669 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.105774959000001, 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:08.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:08.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:08.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:40:08.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:08.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:40:08.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:40:08.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:08.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:08.680 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:08.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:08.683 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.679+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.726 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:40:08.782 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.779+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.827 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:08.827 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:08.828 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2023-07-29T16:40:08.828 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:08.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:08.921 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.918+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:08.984 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:08.981+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:09.003 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:09.004 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:09.004 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:40:09.004 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:40:09.004 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:09.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:09.099 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:09.096+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:09.184 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:09.184 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 76.983155182000004, 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:09.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:09.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:09.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:09.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.572358895000001, 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:09.196 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.201 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.202 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:09.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.205 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.569793836000002, 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.206 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:09.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:09.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:09.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:09.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.214 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:09.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.569493342000001, 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.219 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:09.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.226 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:09.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.231 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.554703529000001, 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:09.232 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:09.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:09.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.241 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.243 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.553802654000002, 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:09.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:09.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.544952901999999, 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.264 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.265 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:09.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.544871049000001, 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:09.268 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:09.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:09.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.273 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:09.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:09.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.543959508999997, 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.280 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.283 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.284 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:09.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.291 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 54.526507240000001, 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.292 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:09.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.294 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:09.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.296 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:09.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:09.303 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.919029713, 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.304 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:09.306 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:09.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:09.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.311 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.916594354000001, 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.313 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:09.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:09.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.318 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.321 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.916508217000001, 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:09.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:09.326 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.327 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:09.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.330 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.916453546, 2023-07-29T16:40:09.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.332 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:09.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.915826334999998, 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.342 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:09.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.347 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:09.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.91539736, 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.351 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:09.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.358 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.359 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.914203818000001, 2023-07-29T16:40:09.360 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.361 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.362 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.363 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.364 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:09.366 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.367 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:09.368 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.914174442, 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:09.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.371 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:09.372 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.373 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:09.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.375 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.376 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.913945042999998, 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.380 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.381 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.382 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:09.383 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.384 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:09.385 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.386 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:09.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 31.913843757999999, 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:09.389 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.390 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:09.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:09.392 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.393 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:09.394 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.395 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:09.396 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.397 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:09.398 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:09.398 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:09.399 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:09.396+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:09.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:09.500 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:09.498+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:09.534 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:09.534 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:09.534 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:40:09.535 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:09.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:40:09.544 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:09.627 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:09.625+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:09.691 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:09.702 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:09.699+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:09.710 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:09.711 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:09.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:40:09.712 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:40:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:09.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:09.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:09.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:09.805 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:09.803+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:09.887 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:09.887 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:09.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:09.941 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:09.938+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:10.005 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.002+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.036 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.036 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:10.105 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.103+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.206 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.204+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.211 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.211 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.221 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:10.307 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.305+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.347 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.348 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.358 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:10.409 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.407+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.486 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.487 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:10.538 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.535+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.610 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:10.607+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:10.662 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.662 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.672 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:10.716 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.714+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:40:10.798 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.798 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.809 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:10.812 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:10.809+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:10.912 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:10.910+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:10.947 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:10.948 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:10.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:11.013 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.011+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.083 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.084 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:11.138 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:11.135+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:11.215 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.213+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.218 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.218 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.228 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:11.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~78s 2023-07-29T16:40:11.316 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:11.314+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:11.356 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.356 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:11.417 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.415+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.490 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.491 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:11.541 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.539+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.618 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.616+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.668 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.669 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.676 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:11.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-07-29T16:40:11.719 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:11.717+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:11.739 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2023-07-29T16:40:11.804 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:11.804 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:11.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:11.819 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.817+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.872 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:11.891 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:11.892 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-07-29T16:40:11.892 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-07-29T16:40:11.892 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:11.894 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:11.895 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:11.920 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:11.918+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:11.981 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:11.981 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:11.981 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:40:11.981 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:40:11.981 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:11.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:12.021 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:12.019+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:12.119 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:12.119 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:12.119 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:12.119 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 79.918187250000003, 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:12.120 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:12.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.122 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.122 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.122 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.126 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.126 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.126 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:12.126 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.127 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.128 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.129 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.130 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:12.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.132 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.132 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.132 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:12.132 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:12.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.507390962999999, 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:12.134 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.135 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.136 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.138 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:12.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.141 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:12.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.143 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.144 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.504825904, 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.145 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.146 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:12.147 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:12.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:12.151 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:12.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.153 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:12.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.155 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:12.156 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.157 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.158 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.504525409999999, 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.159 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:12.163 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:12.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.164 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.164 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.164 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:12.164 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:12.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.165 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.165 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.165 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:12.165 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.168 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.169 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:12.171 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:12.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.489735596999999, 2023-07-29T16:40:12.173 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:12.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.175 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.176 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.180 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:12.182 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.183 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.184 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.184 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:12.184 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:12.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.185 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.185 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:12.185 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:12.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.488834722, 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.187 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.188 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.189 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.190 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:12.190 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.190 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.191 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.191 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:12.191 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.192 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.192 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.192 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:12.192 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.193 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.194 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:12.195 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.196 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:12.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.198 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:12.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:12.201 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.479984969999997, 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.202 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:12.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.206 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.208 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.210 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.210 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:12.210 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:12.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.211 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:12.212 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.213 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.479903116999999, 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:12.214 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.216 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:12.219 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:12.221 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.223 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:12.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.225 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.226 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.478991577000002, 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.227 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:12.228 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.230 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.232 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.232 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:12.232 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:12.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.232 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.233 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.233 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:12.233 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:12.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.233 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.234 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.234 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:12.234 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:12.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.234 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.235 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:12.237 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.238 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.239 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.240 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 57.461539307999999, 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.241 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.242 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.242 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:12.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.244 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:12.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.246 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:12.247 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.248 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:12.249 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.250 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.251 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.251 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:12.251 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:12.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.252 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.252 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:12.252 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.253 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.254 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.854061780999999, 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.255 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.256 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.257 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:12.258 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.259 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.260 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:12.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.262 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:12.263 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.851626422000002, 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:12.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.266 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.268 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:12.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.270 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:12.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.272 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.273 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.851540284999999, 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.274 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.276 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.276 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.276 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:12.276 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.276 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.277 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.278 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:12.279 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.280 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:12.281 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:12.282 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:12.283 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.851485613999998, 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.284 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.286 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:12.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.288 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:12.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.290 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.291 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.292 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.292 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:12.292 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:12.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.292 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.293 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.850858402999997, 2023-07-29T16:40:12.295 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:12.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.297 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:12.298 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.299 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.300 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:12.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.302 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.303 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.850429427999998, 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.305 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.308 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.309 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:12.310 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:12.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.310 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.310 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.311 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:12.311 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:12.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.312 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.312 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.312 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:12.312 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:12.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.313 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.313 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.314 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:12.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.849235886000002, 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.317 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.318 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:12.319 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.320 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:12.321 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.322 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:12.323 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.324 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:12.325 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.326 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.849206510000002, 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.327 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.329 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.330 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.332 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.333 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:12.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.848977110999996, 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.336 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.337 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.338 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:12.339 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.341 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:12.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.344 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.346 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.347 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 34.848875825999997, 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:12.348 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:12.349 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.350 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:12.351 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:12.351 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.351 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:12.352 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:12.352 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:12.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.352 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:12.353 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:12.353 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:12.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.354 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:12.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.356 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:12.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:12.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:12.358 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:12.359 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:12.357+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:12.360 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:12.460 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:12.458+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:12.489 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:40:12.489 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:12.499 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:12.561 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:12.558+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:12.661 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:12.659+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:12.665 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:12.665 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:12.665 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:40:12.665 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:40:12.666 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:12.676 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:12.762 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:12.760+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:12.804 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89433 5.8 5:1b8eed24:::benchmark_data_smithi070_97781_object89432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.750731637000001, 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022524132999999998, 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89433 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050460+0000", 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050459+0000", 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050519+0000", 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9846000000000003e-05 2023-07-29T16:40:12.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050528+0000", 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9949999999999994e-06 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050533+0000", 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0719999999999999e-06 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050581+0000", 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7346999999999999e-05 2023-07-29T16:40:12.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050764+0000", 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018336599999999999 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050925+0000", 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160948 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056311+0000", 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053859420000000003 2023-07-29T16:40:12.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072903+0000", 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016591754 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072941+0000", 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8142999999999997e-05 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.072985+0000", 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.815 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89435 5.8 5:18467598:::benchmark_data_smithi070_97781_object89434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.750647807000007, 2023-07-29T16:40:12.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024021239999999999, 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89435 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.817 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:12.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050544+0000", 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050637+0000", 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3226000000000005e-05 2023-07-29T16:40:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050646+0000", 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1749999999999994e-06 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.050652+0000", 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053212+0000", 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002559497 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053342+0000", 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129949 2023-07-29T16:40:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053447+0000", 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104893 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056326+0000", 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028788949999999998 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074474+0000", 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018148744000000001 2023-07-29T16:40:12.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074525+0000", 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074566+0000", 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0601e-05 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89438 5.e 5:71c8eea8:::benchmark_data_smithi070_97781_object89437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.827 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.748104842000004, 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021697474000000001, 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89438 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053087+0000", 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053086+0000", 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053150+0000", 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4089000000000003e-05 2023-07-29T16:40:12.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053160+0000", 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0032e-05 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053166+0000", 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.558e-06 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053208+0000", 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2354000000000001e-05 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053365+0000", 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015690499999999999 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.053503+0000", 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137687 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.056347+0000", 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028445720000000001 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074692+0000", 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018345 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074752+0000", 2023-07-29T16:40:12.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9267e-05 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.074785+0000", 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3229999999999999e-05 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89443 5.4 5:22dd0e81:::benchmark_data_smithi070_97781_object89442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.733344795999997, 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023119656999999998, 2023-07-29T16:40:12.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89443 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067847+0000", 2023-07-29T16:40:12.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067845+0000", 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067880+0000", 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5027999999999997e-05 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067896+0000", 2023-07-29T16:40:12.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279999999999999e-05 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067905+0000", 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6420000000000002e-06 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.067950+0000", 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4348999999999998e-05 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068081+0000", 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013096399999999999 2023-07-29T16:40:12.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.068193+0000", 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001119 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.070429+0000", 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022359720000000001 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090902+0000", 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020473290000000002 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090939+0000", 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6885999999999999e-05 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.090967+0000", 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8195e-05 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89477 5.b 5:d6e9f368:::benchmark_data_smithi070_97781_object89476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.848 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.705818750000006, 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023840117000000001, 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89477 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095373+0000", 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095399+0000", 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6205999999999999e-05 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095406+0000", 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6839999999999999e-06 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095411+0000", 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3650000000000003e-06 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095440+0000", 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9371000000000001e-05 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095525+0000", 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4520999999999999e-05 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011082399999999999 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099323+0000", 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003687189 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119095+0000", 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019772158000000001 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119150+0000", 2023-07-29T16:40:12.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5429000000000001e-05 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119213+0000", 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2971000000000004e-05 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89479 5.b 5:dc086623:::benchmark_data_smithi070_97781_object89478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.705658946, 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023815983999999998, 2023-07-29T16:40:12.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89479 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095533+0000", 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095532+0000", 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095621+0000", 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8283999999999997e-05 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095629+0000", 2023-07-29T16:40:12.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5930000000000006e-06 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.095636+0000", 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9720000000000003e-06 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097397+0000", 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001761149 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097514+0000", 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116395 2023-07-29T16:40:12.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.097676+0000", 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016175900000000001 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.101195+0000", 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003519019 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119263+0000", 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018068806 2023-07-29T16:40:12.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119311+0000", 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7416000000000001e-05 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.119349+0000", 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8337000000000002e-05 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89485 5.e 5:727e392b:::benchmark_data_smithi070_97781_object89484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.869 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.701531794000005, 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028432308, 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89485 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099660+0000", 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099659+0000", 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099713+0000", 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2023-07-29T16:40:12.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099722+0000", 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2650000000000002e-06 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099730+0000", 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3990000000000004e-06 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099767+0000", 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6844000000000002e-05 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099859+0000", 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1275999999999998e-05 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.099948+0000", 2023-07-29T16:40:12.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8979000000000003e-05 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.104028+0000", 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040801609999999997 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.127991+0000", 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023963432 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128050+0000", 2023-07-29T16:40:12.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8517000000000002e-05 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.128093+0000", 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2970999999999999e-05 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89487 5.e 5:74edc360:::benchmark_data_smithi070_97781_object89486:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.695884989000007, 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026128630999999999, 2023-07-29T16:40:12.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89487 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105307+0000", 2023-07-29T16:40:12.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105306+0000", 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105412+0000", 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010611300000000001 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105421+0000", 2023-07-29T16:40:12.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105427+0000", 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6850000000000004e-06 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105463+0000", 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5148000000000003e-05 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105552+0000", 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9493999999999994e-05 2023-07-29T16:40:12.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.105653+0000", 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101023 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.107578+0000", 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001924505 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131381+0000", 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023803194 2023-07-29T16:40:12.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131413+0000", 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1869000000000003e-05 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.131436+0000", 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3149000000000001e-05 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89551 5.4 5:22397f32:::benchmark_data_smithi070_97781_object89550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.650895696000006, 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022962111, 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89551 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150296+0000", 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150387+0000", 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1009999999999998e-05 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150397+0000", 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0720000000000001e-05 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.150403+0000", 2023-07-29T16:40:12.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8209999999999998e-06 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155496+0000", 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050930100000000002 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155650+0000", 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015395799999999999 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.155799+0000", 2023-07-29T16:40:12.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148966 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.163275+0000", 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074758719999999997 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173172+0000", 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098967710000000004 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173216+0000", 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4586999999999998e-05 2023-07-29T16:40:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.173259+0000", 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2262000000000003e-05 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89651 5.0 5:07b98067:::benchmark_data_smithi070_97781_object89650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.593812788999998, 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076362318999999998, 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.901 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89651 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207379+0000", 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207378+0000", 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207427+0000", 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9381e-05 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207439+0000", 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1344e-05 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207444+0000", 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3700000000000003e-06 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207478+0000", 2023-07-29T16:40:12.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3695000000000002e-05 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207610+0000", 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013181099999999999 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207711+0000", 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101081 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215725+0000", 2023-07-29T16:40:12.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008014663 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283676+0000", 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.067950864 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283708+0000", 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2255000000000002e-05 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.283742+0000", 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3176000000000002e-05 2023-07-29T16:40:12.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89652 5.e 5:7558dbba:::benchmark_data_smithi070_97781_object89651:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.593738705999996, 2023-07-29T16:40:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.080864883999999998, 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89652 2023-07-29T16:40:12.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207453+0000", 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207490+0000", 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7401000000000003e-05 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207499+0000", 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0439999999999996e-06 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207502+0000", 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2023-07-29T16:40:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207537+0000", 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5029e-05 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207625+0000", 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7355000000000006e-05 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207750+0000", 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125105 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215702+0000", 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079524460000000002 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288264+0000", 2023-07-29T16:40:12.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072561487999999993 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288295+0000", 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.288318+0000", 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2914000000000001e-05 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.921 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89653 5.b 5:dbf4c320:::benchmark_data_smithi070_97781_object89652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.593540290999997, 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074742686000000003, 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89653 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:12.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207652+0000", 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207651+0000", 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207714+0000", 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3157000000000005e-05 2023-07-29T16:40:12.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207723+0000", 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6859999999999995e-06 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207731+0000", 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8350000000000004e-06 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207772+0000", 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1301000000000003e-05 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.207895+0000", 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123039 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208017+0000", 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121679 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215730+0000", 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077129540000000002 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282333+0000", 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.066603140000000005 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282369+0000", 2023-07-29T16:40:12.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5762000000000001e-05 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.282394+0000", 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.931 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89654 5.4 5:204b82ff:::benchmark_data_smithi070_97781_object89653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.593158971999998, 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076958443000000001, 2023-07-29T16:40:12.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89654 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208033+0000", 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208032+0000", 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208099+0000", 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6501000000000006e-05 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208110+0000", 2023-07-29T16:40:12.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1423000000000001e-05 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208118+0000", 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208164+0000", 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6662999999999997e-05 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208294+0000", 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129646 2023-07-29T16:40:12.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.208433+0000", 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013854699999999999 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215749+0000", 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073161900000000002 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284935+0000", 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069185754000000002 2023-07-29T16:40:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284969+0000", 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4492000000000001e-05 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.284992+0000", 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2544999999999998e-05 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:89655 5.0 5:0baba909:::benchmark_data_smithi070_97781_object89654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:12.942 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.591765848999998, 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.075726678000000006, 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 89655 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209426+0000", 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209425+0000", 2023-07-29T16:40:12.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209504+0000", 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8162000000000001e-05 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209512+0000", 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1859999999999992e-06 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.209517+0000", 2023-07-29T16:40:12.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.626e-06 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210104+0000", 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058624100000000004 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210267+0000", 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016335899999999999 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.210425+0000", 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015823500000000001 2023-07-29T16:40:12.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.215763+0000", 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053380900000000002 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:12.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285108+0000", 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.069345140999999999 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285134+0000", 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6013999999999999e-05 2023-07-29T16:40:12.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:52.285153+0000", 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8467000000000001e-05 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:99599 5.0 5:005814aa:::benchmark_data_smithi070_97781_object99598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 75.116570021000001, 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021457844, 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 99599 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684622+0000", 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684621+0000", 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684669+0000", 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7604e-05 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684676+0000", 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2099999999999996e-06 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.684682+0000", 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5459999999999999e-06 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687556+0000", 2023-07-29T16:40:12.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028739289999999999 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.687715+0000", 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158992 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.705991+0000", 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018275967000000001 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706025+0000", 2023-07-29T16:40:12.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4598999999999999e-05 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:38:57.706080+0000", 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4663000000000002e-05 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:110540 5.0 5:09f7d08b:::benchmark_data_smithi070_97781_object110539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.556272261000004, 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022105306000000002, 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 110540 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244920+0000", 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.244919+0000", 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245002+0000", 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2887999999999997e-05 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245009+0000", 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.438e-06 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.245015+0000", 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.84e-06 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250464+0000", 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054491690000000002 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.250549+0000", 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5487000000000003e-05 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266925+0000", 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016376124999999998 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.266964+0000", 2023-07-29T16:40:12.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8646000000000002e-05 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:02.267025+0000", 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1180999999999996e-05 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:116191 5.8 5:135cf00f:::benchmark_data_smithi070_97781_object116190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.176619039000002, 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022264472, 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 116191 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:12.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624573+0000", 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624604+0000", 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1599e-05 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624610+0000", 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2023-07-29T16:40:12.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.624613+0000", 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4640000000000002e-06 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626724+0000", 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021105550000000001 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.626857+0000", 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133657 2023-07-29T16:40:12.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646742+0000", 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019885034999999999 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646781+0000", 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8423999999999997e-05 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:04.646838+0000", 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6719999999999999e-05 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117819 5.0 5:0824aa62:::benchmark_data_smithi070_97781_object117818:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.488065872999996, 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025786811, 2023-07-29T16:40:12.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117819 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313126+0000", 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313125+0000", 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313176+0000", 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0701999999999997e-05 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313190+0000", 2023-07-29T16:40:12.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4727e-05 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313199+0000", 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313241+0000", 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2218999999999997e-05 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.313357+0000", 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115971 2023-07-29T16:40:12.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338830+0000", 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025472807 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338863+0000", 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2511000000000001e-05 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.338913+0000", 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0475e-05 2023-07-29T16:40:12.988 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117830 5.8 5:16cefbbb:::benchmark_data_smithi070_97781_object117829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.483171392000003, 2023-07-29T16:40:12.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023469149000000002, 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117830 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:12.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318021+0000", 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318020+0000", 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:12.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318046+0000", 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5391000000000001e-05 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:12.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318053+0000", 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7970000000000001e-06 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318060+0000", 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6170000000000003e-06 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318109+0000", 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8872000000000002e-05 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.318244+0000", 2023-07-29T16:40:12.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013463 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341343+0000", 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023099458999999999 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341394+0000", 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550999999999998e-05 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341490+0000", 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6266000000000003e-05 2023-07-29T16:40:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4749.0:117832 5.0 5:026951b4:::benchmark_data_smithi070_97781_object117831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.481503645999993, 2023-07-29T16:40:12.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021946948000000001, 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4749", 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 117832 2023-07-29T16:40:12.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319688+0000", 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319717+0000", 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2023-07-29T16:40:13.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319724+0000", 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2649999999999999e-06 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319729+0000", 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4949999999999999e-06 2023-07-29T16:40:13.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319881+0000", 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151445 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2023-07-29T16:40:13.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.319991+0000", 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011032200000000001 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341499+0000", 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021507670999999999 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341551+0000", 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1774000000000003e-05 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2023-07-29T16:39:05.341635+0000", 2023-07-29T16:40:13.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4726000000000002e-05 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2023-07-29T16:40:13.007 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:13.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:13.009 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.006+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.109 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.106+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.148 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:13.149 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:13.149 INFO:teuthology.orchestra.run.smithi102.stdout: "num_ops": 0 2023-07-29T16:40:13.150 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:13.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:13.242 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.239+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.311 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.308+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.325 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:13.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [], 2023-07-29T16:40:13.326 INFO:teuthology.orchestra.run.smithi102.stdout: "complaint_time": 30, 2023-07-29T16:40:13.326 INFO:teuthology.orchestra.run.smithi102.stdout: "num_blocked_ops": 0 2023-07-29T16:40:13.326 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:13.335 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:13.419 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.416+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.506 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-07-29T16:40:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 20, 2023-07-29T16:40:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 600, 2023-07-29T16:40:13.506 INFO:teuthology.orchestra.run.smithi102.stdout: "ops": [ 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:89631 5.2 5:415d9127:::benchmark_data_smithi070_97781_object89630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 81.305008973, 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083823976999999994, 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.507 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 89631 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197220+0000", 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197219+0000", 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.510 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197366+0000", 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00014654199999999999 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197375+0000", 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6399999999999992e-06 2023-07-29T16:40:13.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197381+0000", 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3879999999999999e-06 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.512 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197419+0000", 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8745999999999998e-05 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197555+0000", 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013517299999999999 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.513 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 2", 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.197706+0000", 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00015140600000000001 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.200502+0000", 2023-07-29T16:40:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0027964959999999999 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.280960+0000", 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080457796999999998 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281009+0000", 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8806e-05 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:38:52.281044+0000", 2023-07-29T16:40:13.516 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4824999999999999e-05 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140492 5.d 5:b60c1630:::benchmark_data_smithi070_97781_object140491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:13.517 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.894212686000003, 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0179071070000001, 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "reached pg", 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140492 2023-07-29T16:40:13.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.519 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608016+0000", 2023-07-29T16:40:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608075+0000", 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9438999999999998e-05 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.521 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608080+0000", 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.366e-06 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608084+0000", 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4259999999999999e-06 2023-07-29T16:40:13.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608121+0000", 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7017999999999997e-05 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op must wait for map", 2023-07-29T16:40:13.523 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.608127+0000", 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3810000000000004e-06 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620344+0000", 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.012216792000000001 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.524 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620352+0000", 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.4109999999999996e-06 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.525 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625034+0000", 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.004681854 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.625923+0000", 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00088900100000000005 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.526 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140521 5.d 5:b760d549:::benchmark_data_smithi070_97781_object140520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.891647626999998, 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.036857071, 2023-07-29T16:40:13.527 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140521 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.529 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610581+0000", 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.530 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610631+0000", 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0760999999999997e-05 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610639+0000", 2023-07-29T16:40:13.531 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6990000000000003e-06 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610645+0000", 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7409999999999998e-06 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610673+0000", 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8717999999999998e-05 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610679+0000", 2023-07-29T16:40:13.533 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.2089999999999996e-06 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620388+0000", 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0097088680000000007 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.534 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620396+0000", 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7099999999999996e-06 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626136+0000", 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0057399419999999 2023-07-29T16:40:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626455+0000", 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000318404 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.536 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.626642+0000", 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000187763 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637455+0000", 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.010813075 2023-07-29T16:40:13.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647377+0000", 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0099210889999999993 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.538 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647411+0000", 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4811000000000003e-05 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.647438+0000", 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6964000000000001e-05 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.539 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140523 5.d 5:bd3db59d:::benchmark_data_smithi070_97781_object140522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.891347132999996, 2023-07-29T16:40:13.540 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0377921080000001, 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140523 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610882+0000", 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610881+0000", 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610913+0000", 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2240000000000003e-05 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610922+0000", 2023-07-29T16:40:13.544 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.6799999999999999e-06 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.610929+0000", 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.691e-06 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.545 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611024+0000", 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.5303999999999994e-05 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting_for_map not empty", 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.611030+0000", 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6729999999999997e-06 2023-07-29T16:40:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620466+0000", 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0094365000000000004 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.547 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.620480+0000", 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3528e-05 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629748+0000", 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.009268225 2023-07-29T16:40:13.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629842+0000", 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4353999999999998e-05 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.629948+0000", 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010567400000000001 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637463+0000", 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0075154050000000002 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648617+0000", 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011153723000000001 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648649+0000", 2023-07-29T16:40:13.551 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2276000000000001e-05 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648674+0000", 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4474e-05 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.552 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140544 5.d 5:be5f628d:::benchmark_data_smithi070_97781_object140543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.876557320000003, 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0230888789999999, 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.553 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140544 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.554 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625672+0000", 2023-07-29T16:40:13.555 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625671+0000", 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625719+0000", 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8429e-05 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625730+0000", 2023-07-29T16:40:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0679999999999999e-05 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625737+0000", 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2699999999999999e-06 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.558 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625871+0000", 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013367500000000001 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.625880+0000", 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2639999999999997e-06 2023-07-29T16:40:13.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631516+0000", 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0056363800000001 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.560 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631638+0000", 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000121983 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.631802+0000", 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00016352399999999999 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637470+0000", 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056681090000000002 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648711+0000", 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.011240867 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648740+0000", 2023-07-29T16:40:13.563 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8583999999999999e-05 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.648760+0000", 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.084e-05 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.564 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140548 5.d 5:b8ad9b87:::benchmark_data_smithi070_97781_object140547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.875656444999997, 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.022525012, 2023-07-29T16:40:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140548 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.566 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:13.567 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626572+0000", 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.568 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626678+0000", 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000106018 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626691+0000", 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3481e-05 2023-07-29T16:40:13.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626714+0000", 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2668e-05 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.570 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626760+0000", 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6103000000000002e-05 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.626770+0000", 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6369999999999994e-06 2023-07-29T16:40:13.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633891+0000", 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0071210989999999 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.572 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.633987+0000", 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6095999999999996e-05 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.634097+0000", 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000110488 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.573 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639750+0000", 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0056527130000000002 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649046+0000", 2023-07-29T16:40:13.574 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0092956410000000003 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649075+0000", 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.8858000000000001e-05 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.575 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649097+0000", 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.2883000000000001e-05 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140571 5.d 5:bec2d20f:::benchmark_data_smithi070_97781_object140570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.866806693000001, 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.013771253, 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.577 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140571 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:13.578 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.579 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635422+0000", 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635456+0000", 2023-07-29T16:40:13.580 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4146000000000001e-05 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635463+0000", 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6359999999999994e-06 2023-07-29T16:40:13.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635474+0000", 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0814e-05 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635527+0000", 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3050000000000002e-05 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635539+0000", 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1482e-05 2023-07-29T16:40:13.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635272+0000", 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.999733337 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.584 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635368+0000", 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6219999999999997e-05 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.635455+0000", 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.7081000000000002e-05 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.585 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.586 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.586 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.639757+0000", 2023-07-29T16:40:13.586 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0043017400000000001 2023-07-29T16:40:13.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.586 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649140+0000", 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0093826970000000006 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649174+0000", 2023-07-29T16:40:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3736999999999999e-05 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649193+0000", 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.9745000000000002e-05 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.588 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140572 5.d 5:bd204873:::benchmark_data_smithi070_97781_object140571:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.866724840000003, 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0137745579999999, 2023-07-29T16:40:13.589 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140572 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.590 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635504+0000", 2023-07-29T16:40:13.591 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635503+0000", 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635576+0000", 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.2488000000000001e-05 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635583+0000", 2023-07-29T16:40:13.593 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.0829999999999998e-06 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635588+0000", 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.3730000000000001e-06 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635634+0000", 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5512000000000001e-05 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.635645+0000", 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.1019000000000001e-05 2023-07-29T16:40:13.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636372+0000", 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0007269089999999 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.596 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636479+0000", 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010707199999999999 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.636572+0000", 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.3445999999999999e-05 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.597 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.641888+0000", 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0053160170000000001 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649229+0000", 2023-07-29T16:40:13.598 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0073406369999999997 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649254+0000", 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4868999999999999e-05 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.599 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649279+0000", 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.4678e-05 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.600 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140574 5.d 5:b07fe665:::benchmark_data_smithi070_97781_object140573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.865813299999999, 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.012968176, 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.601 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140574 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636416+0000", 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.603 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636415+0000", 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636523+0000", 2023-07-29T16:40:13.604 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000107868 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636533+0000", 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7690000000000008e-06 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.605 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636538+0000", 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.8449999999999999e-06 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636577+0000", 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.8130000000000003e-05 2023-07-29T16:40:13.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.636586+0000", 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.6590000000000002e-06 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637501+0000", 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.000914777 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637596+0000", 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.4863000000000003e-05 2023-07-29T16:40:13.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.637689+0000", 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.2657000000000004e-05 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.609 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.644104+0000", 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0064154629999999997 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649328+0000", 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.005224083 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.610 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649362+0000", 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4078999999999997e-05 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649384+0000", 2023-07-29T16:40:13.611 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.1579000000000001e-05 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:140604 5.d 5:b9f2c81e:::benchmark_data_smithi070_97781_object140603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-07-29T16:40:13.612 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 58.848361031000003, 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.99565224500000005, 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.613 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 140604 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.614 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653868+0000", 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653867+0000", 2023-07-29T16:40:13.615 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653929+0000", 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.1210999999999994e-05 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.616 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653935+0000", 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7129999999999999e-06 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653939+0000", 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.98e-06 2023-07-29T16:40:13.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.653996+0000", 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.6768999999999998e-05 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.618 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for peered", 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:14.654009+0000", 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.288e-05 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638590+0000", 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.98458112399999997 2023-07-29T16:40:13.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638716+0000", 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012555800000000001 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.620 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.638821+0000", 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010514 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.646234+0000", 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0074135 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.621 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649439+0000", 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0032043229999999998 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649479+0000", 2023-07-29T16:40:13.622 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.0525999999999998e-05 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:15.649520+0000", 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1013000000000002e-05 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199449 5.c 5:3a72f893:::benchmark_data_smithi070_97781_object57664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.240883504000003, 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084714120000000004, 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199449 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.625 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:13.626 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261345+0000", 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.627 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261347+0000", 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.3760000000000002e-06 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261358+0000", 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.0292000000000001e-05 2023-07-29T16:40:13.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.261362+0000", 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.9269999999999996e-06 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.629 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262868+0000", 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015054370000000001 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.262932+0000", 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4259999999999998e-05 2023-07-29T16:40:13.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345940+0000", 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083008308000000003 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.631 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.345986+0000", 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.5065000000000003e-05 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346059+0000", 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3894999999999996e-05 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.632 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199452 5.2 5:435e20ce:::benchmark_data_smithi070_97781_object57667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.238448145, 2023-07-29T16:40:13.633 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080665201000000006, 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199452 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.634 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.635 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263781+0000", 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263780+0000", 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263784+0000", 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.428e-06 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263790+0000", 2023-07-29T16:40:13.637 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.4819999999999999e-06 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263795+0000", 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.7600000000000002e-06 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.638 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263826+0000", 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.0818000000000002e-05 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263925+0000", 2023-07-29T16:40:13.639 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.9164000000000001e-05 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344309+0000", 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080384534999999993 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.640 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344373+0000", 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3510999999999996e-05 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344446+0000", 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3020000000000002e-05 2023-07-29T16:40:13.641 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199454 5.3 5:c60821a7:::benchmark_data_smithi070_97781_object57669:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.238362008000003, 2023-07-29T16:40:13.642 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080542832999999994, 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199454 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.643 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.644 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263867+0000", 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263866+0000", 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263870+0000", 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6289999999999999e-06 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.646 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263877+0000", 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.7560000000000002e-06 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263882+0000", 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.9689999999999999e-06 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263917+0000", 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4700000000000003e-05 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263997+0000", 2023-07-29T16:40:13.648 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 8.0025999999999996e-05 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344271+0000", 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080273338 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.649 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344331+0000", 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.0115000000000003e-05 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344410+0000", 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8980000000000006e-05 2023-07-29T16:40:13.650 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199455 5.d 5:bb122f4c:::benchmark_data_smithi070_97781_object57670:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:13.651 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.238307337000002, 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083892625999999998, 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199455 2023-07-29T16:40:13.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.653 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263921+0000", 2023-07-29T16:40:13.654 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263924+0000", 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4989999999999999e-06 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.655 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263931+0000", 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.9600000000000003e-06 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263937+0000", 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.7309999999999998e-06 2023-07-29T16:40:13.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.263970+0000", 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.2789000000000001e-05 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.657 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264046+0000", 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6024000000000003e-05 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264110+0000", 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3894999999999997e-05 2023-07-29T16:40:13.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.346212+0000", 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.082102119000000001 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.659 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347743+0000", 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0015307000000000001 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347777+0000", 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4629999999999999e-05 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.660 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347814+0000", 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.6986999999999997e-05 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.661 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199456 5.7 5:e2ae920c:::benchmark_data_smithi070_97781_object57671:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.237680126000001, 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079867653999999996, 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.662 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199456 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:13.663 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264549+0000", 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264548+0000", 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264553+0000", 2023-07-29T16:40:13.665 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6149999999999999e-06 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264562+0000", 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.234e-06 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.666 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264568+0000", 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.6100000000000002e-06 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264602+0000", 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.3416e-05 2023-07-29T16:40:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264676+0000", 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.3744000000000004e-05 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.668 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344275+0000", 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079599088999999998 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344340+0000", 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.5167999999999997e-05 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.669 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344416+0000", 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.6594000000000006e-05 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.670 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199457 5.3 5:cb2621a8:::benchmark_data_smithi070_97781_object57672:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.237251151000002, 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079881509000000003, 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.671 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199457 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.672 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264978+0000", 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264977+0000", 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264981+0000", 2023-07-29T16:40:13.674 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.4599999999999999e-06 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264988+0000", 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.5680000000000002e-06 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.675 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.264994+0000", 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.5559999999999998e-06 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265476+0000", 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00048231899999999999 2023-07-29T16:40:13.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.265555+0000", 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8527000000000002e-05 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.677 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344756+0000", 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.079200942999999996 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344797+0000", 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.1019999999999997e-05 2023-07-29T16:40:13.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344859+0000", 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.2643000000000003e-05 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.679 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199459 5.6 5:6921586e:::benchmark_data_smithi070_97781_object57674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.236057609, 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081176318999999997, 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.680 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199459 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.681 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266171+0000", 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.682 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266170+0000", 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.683 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266175+0000", 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6249999999999998e-06 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266185+0000", 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 9.7739999999999999e-06 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.684 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266190+0000", 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.4589999999999997e-06 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266234+0000", 2023-07-29T16:40:13.685 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.4073999999999998e-05 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266361+0000", 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00012678200000000001 2023-07-29T16:40:13.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347250+0000", 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.080888744999999998 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.687 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347284+0000", 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.383e-05 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347348+0000", 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3777999999999998e-05 2023-07-29T16:40:13.688 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199461 5.5 5:aad770d9:::benchmark_data_smithi070_97781_object57676:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.236028232999999, 2023-07-29T16:40:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081694718999999999, 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199461 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.690 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.691 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266201+0000", 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266200+0000", 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266203+0000", 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.497e-06 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.693 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266209+0000", 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 6.3149999999999997e-06 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266214+0000", 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0490000000000003e-06 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.694 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266251+0000", 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7214e-05 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266352+0000", 2023-07-29T16:40:13.695 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00010045800000000001 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347821+0000", 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.081468863000000002 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.696 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347847+0000", 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.5995000000000001e-05 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347895+0000", 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.8695e-05 2023-07-29T16:40:13.697 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199463 5.d 5:b2dcf848:::benchmark_data_smithi070_97781_object57678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.235798834000001, 2023-07-29T16:40:13.698 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.083644758, 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199463 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.700 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266430+0000", 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266429+0000", 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.999999 2023-07-29T16:40:13.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266433+0000", 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.2400000000000001e-06 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.702 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266441+0000", 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.96e-06 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266447+0000", 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.429e-06 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.703 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266486+0000", 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.9480999999999997e-05 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.704 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344098+0000", 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077611636999999997 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "waiting for subops from 0", 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344213+0000", 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.000115105 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.705 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "sub_op_commit_rec", 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.347729+0000", 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0035162140000000001 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350009+0000", 2023-07-29T16:40:13.706 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0022792939999999999 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350038+0000", 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.9074e-05 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.707 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350075+0000", 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 3.7095000000000003e-05 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.708 INFO:teuthology.orchestra.run.smithi102.stdout: "description": "osd_op(client.4749.0:199464 5.1 5:8db7221b:::benchmark_data_smithi070_97781_object57679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "initiated_at": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "age": 36.235697549000001, 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.084064974000000001, 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "type_data": { 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "flag_point": "commit sent; apply or cleanup", 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_info": { 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client": "client.4749", 2023-07-29T16:40:13.709 INFO:teuthology.orchestra.run.smithi102.stdout: "client_addr": "172.21.15.70:0/4018773836", 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tid": 199464 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: "events": [ 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "initiated", 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:13.710 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "throttled", 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.711 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "header_read", 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266531+0000", 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4294967295.9999995 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "all_read", 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.266533+0000", 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 2.6309999999999999e-06 2023-07-29T16:40:13.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "dispatched", 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344004+0000", 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.077470768999999995 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "queued_for_pg", 2023-07-29T16:40:13.713 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344017+0000", 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 1.3295000000000001e-05 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "reached_pg", 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344068+0000", 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 5.0998000000000002e-05 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "started", 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.344208+0000", 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.00013924299999999999 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "op_commit", 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350472+0000", 2023-07-29T16:40:13.715 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 0.0062639669999999996 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "commit_sent", 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350518+0000", 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 4.6066999999999998e-05 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-07-29T16:40:13.716 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: "event": "done", 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: "time": "2023-07-29T16:39:37.350596+0000", 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: "duration": 7.8499999999999997e-05 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-07-29T16:40:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-07-29T16:40:13.718 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-07-29T16:40:13.718 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2023-07-29T16:40:13.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2023-07-29T16:40:13.720 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.716+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.720 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:13.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-07-29T16:40:13.819 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:13.817+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:13.859 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2023-07-29T16:40:13.860 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:13.869 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:13.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-07-29T16:40:13.920 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:13.918+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:13.995 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2023-07-29T16:40:13.995 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2023-07-29T16:40:13.995 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2023-07-29T16:40:13.995 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2023-07-29T16:40:13.996 INFO:teuthology.orchestra.run.smithi098.stdout:} 2023-07-29T16:40:14.004 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:14.040 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2023-07-29T16:40:14.045 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:14.043+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:14.075 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2023-07-29T16:40:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-07-29T16:40:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-07-29T16:40:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-07-29T16:40:14.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-29T16:40:14.078 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-07-29T16:40:14.122 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:14.119+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:14.169 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.169 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:14.223 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:14.220+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:14.309 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.309 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:14.360 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:14.357+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:14.424 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:14.421+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:14.485 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.485 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:14.526 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:14.524+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:14.626 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:14.623+0000 7f24891aa700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:14.661 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.661 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-07-29T16:40:14.727 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:14.725+0000 7f0b05791700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:14.742 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'unique_pool_0' removed 2023-07-29T16:40:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2023-07-29T16:40:14.756 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-07-29T16:40:14.770 INFO:tasks.thrashosds:joining thrashosds 2023-07-29T16:40:14.800 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.800 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.810 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-07-29T16:40:14.976 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:14.976 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:14.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-07-29T16:40:15.112 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:15.113 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:15.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-07-29T16:40:15.251 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:15.251 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:15.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-07-29T16:40:15.388 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:15.388 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:15.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-07-29T16:40:15.525 INFO:teuthology.orchestra.run.smithi102.stdout:ERROR: (22) Invalid argument 2023-07-29T16:40:15.525 INFO:teuthology.orchestra.run.smithi102.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-07-29T16:40:16.093 INFO:teuthology.orchestra.console.smithi151:Failed to get ipmi console status: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte 2023-07-29T16:40:16.195 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1401, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 558, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 3030, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.2 via ipmi 2023-07-29T16:40:16.195 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1269, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1401, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 558, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 3030, in revive_osd raise Exception('Failed to revive osd.{o} via ipmi'. Exception: Failed to revive osd.2 via ipmi 2023-07-29T16:40:16.196 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-07-29T16:40:16.196 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-07-29T16:40:16.196 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-07-29T16:40:16.197 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-07-29T16:40:16.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-07-29T16:40:17.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~83s 2023-07-29T16:40:17.098 INFO:tasks.daemonwatchdog.daemon_watchdog:OSDThrasher failed 2023-07-29T16:40:17.098 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-29T16:40:17.750 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2023-07-29T16:40:17.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-07-29T16:40:17.904 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-29T16:40:17.904 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-29T16:40:17.905 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-29T16:40:17.905 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-29T16:40:17.906 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-29T16:40:17.906 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-29T16:40:17.907 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-29T16:40:17.907 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-29T16:40:17.908 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:17.903+0000 7f24891aa700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 94554) UID: 0 2023-07-29T16:40:17.909 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:17.903+0000 7f24891aa700 -1 osd.1 72 *** Got signal Terminated *** 2023-07-29T16:40:17.909 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-07-29T16:40:17.903+0000 7f24891aa700 -1 osd.1 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-29T16:40:17.909 INFO:tasks.ceph.mds.a.smithi070.stderr:2023-07-29T16:40:17.902+0000 7ff072ab7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 94681) UID: 0 2023-07-29T16:40:17.909 INFO:tasks.ceph.mds.a.smithi070.stderr:2023-07-29T16:40:17.902+0000 7ff072ab7700 -1 mds.a *** got signal Terminated *** 2023-07-29T16:40:17.910 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:17.902+0000 7f0b05791700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 94562) UID: 0 2023-07-29T16:40:17.910 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:17.902+0000 7f0b05791700 -1 osd.0 73 *** Got signal Terminated *** 2023-07-29T16:40:17.910 INFO:tasks.ceph.osd.0.smithi098.stderr:2023-07-29T16:40:17.902+0000 7f0b05791700 -1 osd.0 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-29T16:40:17.910 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-07-29T16:40:17.903+0000 7f9b4427c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 93919) UID: 0 2023-07-29T16:40:17.910 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-07-29T16:40:17.903+0000 7f9b4427c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-29T16:40:17.911 INFO:tasks.ceph.mon.b.smithi070.stderr:2023-07-29T16:40:17.903+0000 7f6e7a25a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 93929) UID: 0 2023-07-29T16:40:17.911 INFO:tasks.ceph.mon.b.smithi070.stderr:2023-07-29T16:40:17.903+0000 7f6e7a25a700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-29T16:40:17.911 INFO:tasks.ceph.mon.c.smithi070.stderr:2023-07-29T16:40:17.905+0000 7f6d6faf3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 93936) UID: 0 2023-07-29T16:40:17.911 INFO:tasks.ceph.mon.c.smithi070.stderr:2023-07-29T16:40:17.905+0000 7f6d6faf3700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-29T16:40:17.912 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:40:17.907+0000 7f5ba4098700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 93940) UID: 0 2023-07-29T16:40:17.912 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-07-29T16:40:17.907+0000 7f5ba4098700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-29T16:40:17.940 INFO:tasks.ceph.mon.a.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: In function 'virtual Monitor::~Monitor()' thread 7f9b4e51ccc0 time 2023-07-29T16:40:17.938256+0000 2023-07-29T16:40:17.940 INFO:tasks.ceph.mon.a.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: 285: FAILED ceph_assert(session_map.sessions.empty()) 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9b4d95fdbb] 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.941 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: main() 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: __libc_start_main() 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: _start() 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr:*** Caught signal (Aborted) ** 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr: in thread 7f9b4e51ccc0 thread_name:ceph-mon 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-07-29T16:40:17.938+0000 7f9b4e51ccc0 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: In function 'virtual Monitor::~Monitor()' thread 7f9b4e51ccc0 time 2023-07-29T16:40:17.938256+0000 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: 285: FAILED ceph_assert(session_map.sessions.empty()) 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.942 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9b4d95fdbb] 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: main() 2023-07-29T16:40:17.943 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: __libc_start_main() 2023-07-29T16:40:17.944 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: _start() 2023-07-29T16:40:17.944 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.944 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.944 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9b4b17bce0] 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: gsignal() 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: abort() 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9b4d95fe15] 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.945 INFO:tasks.ceph.mon.a.smithi070.stderr: 8: main() 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: 9: __libc_start_main() 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: 10: _start() 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-07-29T16:40:17.939+0000 7f9b4e51ccc0 -1 *** Caught signal (Aborted) ** 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: in thread 7f9b4e51ccc0 thread_name:ceph-mon 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9b4b17bce0] 2023-07-29T16:40:17.946 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: gsignal() 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: abort() 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9b4d95fe15] 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 8: main() 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 9: __libc_start_main() 2023-07-29T16:40:17.947 INFO:tasks.ceph.mon.a.smithi070.stderr: 10: _start() 2023-07-29T16:40:17.948 INFO:tasks.ceph.mon.a.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-29T16:40:17.948 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.956 INFO:tasks.ceph.mon.a.smithi070.stderr: -505> 2023-07-29T16:40:17.903+0000 7f9b4427c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 93919) UID: 0 2023-07-29T16:40:17.956 INFO:tasks.ceph.mon.a.smithi070.stderr: -504> 2023-07-29T16:40:17.903+0000 7f9b4427c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-29T16:40:17.957 INFO:tasks.ceph.mon.a.smithi070.stderr: -1> 2023-07-29T16:40:17.938+0000 7f9b4e51ccc0 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: In function 'virtual Monitor::~Monitor()' thread 7f9b4e51ccc0 time 2023-07-29T16:40:17.938256+0000 2023-07-29T16:40:17.957 INFO:tasks.ceph.mon.a.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.1.3-11-g0484097b/rpm/el8/BUILD/ceph-18.1.3-11-g0484097b/src/mon/Monitor.cc: 285: FAILED ceph_assert(session_map.sessions.empty()) 2023-07-29T16:40:17.957 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.957 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.957 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9b4d95fdbb] 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: main() 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: __libc_start_main() 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: _start() 2023-07-29T16:40:17.958 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: 0> 2023-07-29T16:40:17.939+0000 7f9b4e51ccc0 -1 *** Caught signal (Aborted) ** 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: in thread 7f9b4e51ccc0 thread_name:ceph-mon 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc) 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f9b4b17bce0] 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: 2: gsignal() 2023-07-29T16:40:17.959 INFO:tasks.ceph.mon.a.smithi070.stderr: 3: abort() 2023-07-29T16:40:17.960 INFO:tasks.ceph.mon.a.smithi070.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9b4d95fe15] 2023-07-29T16:40:17.960 INFO:tasks.ceph.mon.a.smithi070.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f81) [0x7f9b4d95ff81] 2023-07-29T16:40:17.960 INFO:tasks.ceph.mon.a.smithi070.stderr: 6: ceph-mon(+0x39eff6) [0x55fad5f79ff6] 2023-07-29T16:40:17.960 INFO:tasks.ceph.mon.a.smithi070.stderr: 7: (Monitor::~Monitor()+0xd) [0x55fad5f7a03d] 2023-07-29T16:40:17.960 INFO:tasks.ceph.mon.a.smithi070.stderr: 8: main() 2023-07-29T16:40:17.961 INFO:tasks.ceph.mon.a.smithi070.stderr: 9: __libc_start_main() 2023-07-29T16:40:17.961 INFO:tasks.ceph.mon.a.smithi070.stderr: 10: _start() 2023-07-29T16:40:17.961 INFO:tasks.ceph.mon.a.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-29T16:40:17.961 INFO:tasks.ceph.mon.a.smithi070.stderr: 2023-07-29T16:40:18.111 INFO:tasks.ceph.mgr.y.smithi070.stderr:daemon-helper: command crashed with signal 15 2023-07-29T16:40:18.307 INFO:tasks.ceph.mon.a.smithi070.stderr:daemon-helper: command crashed with signal 11 2023-07-29T16:42:17.799 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-07-29T16:42:17.800 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1356, in do_noscrub_toggle self.ceph_manager.raw_cluster_cmd('osd', 'unset', 'nodeep-scrub') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub' 2023-07-29T16:42:17.805 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 190, in wrapper return func(self) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1356, in do_noscrub_toggle self.ceph_manager.raw_cluster_cmd('osd', 'unset', 'nodeep-scrub') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub' 2023-07-29T16:42:17.806 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-29T16:42:17.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T16:44:17.857 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-07-29T16:44:17.858 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T16:44:17.859 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-29T16:44:17.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T16:44:17.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T16:46:17.907 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-07-29T16:46:17.908 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-07-29T16:46:17.909 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-29T16:46:17.909 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-29T16:46:17.910 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.910 INFO:tasks.ceph.mds.a:Stopped 2023-07-29T16:46:17.911 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-29T16:46:17.911 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-29T16:46:17.912 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.912 INFO:tasks.ceph.osd.0:Stopped 2023-07-29T16:46:17.913 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-29T16:46:17.913 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.914 INFO:tasks.ceph.osd.1:Stopped 2023-07-29T16:46:17.914 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-29T16:46:17.914 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-29T16:46:17.915 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2023-07-29T16:46:17.916 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-29T16:46:17.917 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-29T16:46:17.917 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.918 INFO:tasks.ceph.mgr.x:Stopped 2023-07-29T16:46:17.918 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-29T16:46:17.919 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:46:17.920 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1465, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1178, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-07-29T16:46:17.921 INFO:tasks.ceph.mgr.y:Stopped 2023-07-29T16:46:17.921 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-29T16:46:17.922 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-29T16:46:17.922 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:46:17.923 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1465, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1178, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/misc.py", line 1171, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2023-07-29T16:46:17.924 INFO:tasks.ceph.mon.a:Stopped 2023-07-29T16:46:17.925 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-29T16:46:17.925 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.926 INFO:tasks.ceph.mon.b:Stopped 2023-07-29T16:46:17.926 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-29T16:46:17.927 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T16:46:17.927 INFO:tasks.ceph.mon.c:Stopped 2023-07-29T16:46:17.928 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-29T16:46:17.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-07-29T16:46:17.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-29T16:46:17.968 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-29T16:46:18.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2023-07-29T16:46:18.106 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-29T16:46:18.253 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:46:18.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-29T16:46:18.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T16:46:18.602 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-29T16:46:18.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-29T16:46:18.853 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-29T16:46:19.069 INFO:teuthology.orchestra.run.smithi151.stderr:umount: /var/lib/ceph/osd/ceph-2: not mounted. 2023-07-29T16:46:19.070 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T16:46:19.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-07-29T16:46:19.197 INFO:teuthology.orchestra.run.smithi151.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-07-29T16:46:19.197 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.197 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.197 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.199 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.200 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.201 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.202 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 576141 25076 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 3w CHR 1,11 0t0 3081 /dev/kmsg 2023-07-29T16:46:19.203 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 5u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 7u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 8u netlink 0t0 1421 KOBJECT_UEVENT 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 9u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.204 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 11u netlink 0t0 15348 AUDIT 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 12r REG 0,5 0 16469 /proc/1/mountinfo 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 13r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 15u unix 0xffff9fae00b5e300 0t0 1422 /run/systemd/private type=STREAM 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 16r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 17u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.205 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 22u unix 0xffff9fadc94dd580 0t0 46227 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 23r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 24u unix 0xffff9fae00a1ad00 0t0 16471 /run/systemd/notify type=DGRAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 25u unix 0xffff9fae00a18480 0t0 16473 /run/systemd/cgroups-agent type=DGRAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 26u unix 0xffff9fae00a1c380 0t0 16475 type=DGRAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 27u unix 0xffff9fae00a1a400 0t0 16476 type=DGRAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 28u unix 0xffff9fae0097bf00 0t0 15479 /run/systemd/journal/dev-log type=DGRAM 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 29r CHR 10,235 0t0 13274 /dev/autofs 2023-07-29T16:46:19.206 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 30r FIFO 0,13 0t0 15360 pipe 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 31u unix 0xffff9fadc94dbf00 0t0 20483 /run/lvm/lvmpolld.socket type=STREAM 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 32u unix 0xffff9fae0097a880 0t0 15484 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 33u unix 0xffff9fae00979680 0t0 15487 /run/systemd/journal/socket type=DGRAM 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 34u netlink 0t0 20486 KOBJECT_UEVENT 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 35u unix 0xffff9fadc94da880 0t0 20487 /run/udev/control type=SEQPACKET 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 36u FIFO 0,24 0t0 20489 /run/dmeventd-server 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 37u FIFO 0,24 0t0 20490 /run/dmeventd-client 2023-07-29T16:46:19.207 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 38u unix 0xffff9fae00b6a880 0t0 18737 /run/systemd/coredump type=SEQPACKET 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 39u FIFO 0,24 0t0 317 /run/initctl 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 40u unix 0xffff9fadc9571f80 0t0 327 /run/rpcbind.sock type=STREAM 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 41u IPv4 330 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 42u IPv4 331 0t0 UDP *:sunrpc 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 43u IPv6 332 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T16:46:19.208 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 44u IPv6 333 0t0 UDP *:sunrpc 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 45u unix 0xffff9fadc94de300 0t0 20508 type=DGRAM 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 46u unix 0xffff9fae00b6f080 0t0 14022 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 48u unix 0xffff9fae00b6e780 0t0 28018 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 49u unix 0xffff9fae0097ba80 0t0 18085 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 50u netlink 0t0 1440 SELINUX 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 51u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.209 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 52u unix 0xffff9fae00b5ba80 0t0 1792 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 53u unix 0xffff9fae00b5c800 0t0 1796 /run/avahi-daemon/socket type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 54u unix 0xffff9fae00b58d80 0t0 1800 /var/run/cups/cups.sock type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 55u unix 0xffff9fae00b6b600 0t0 19256 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 56u unix 0xffff9fadc9574800 0t0 1017 type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 57u unix 0xffff9fae00b59680 0t0 28210 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 58u unix 0xffff9fae00ba9680 0t0 20988 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 59u unix 0xffff9fadc9577980 0t0 22596 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 60u unix 0xffff9fae00b5da00 0t0 20990 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 61u unix 0xffff9fadc94dba80 0t0 19260 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 63u unix 0xffff9fae00b6f500 0t0 20994 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 64u unix 0xffff9fae00b5a400 0t0 22610 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 65u unix 0xffff9fae00b58480 0t0 22612 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 67u unix 0xffff9fadc9570d80 0t0 20909 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 68u unix 0xffff9fadc957e780 0t0 20911 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 69u unix 0xffff9fadc94dcc80 0t0 27954 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.211 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 70u unix 0xffff9fadc957f980 0t0 27956 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 71u unix 0xffff9fadc957da00 0t0 27958 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 74u unix 0xffff9fae00ba8d80 0t0 31881 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 1 root 75u unix 0xffff9fae00a1a880 0t0 21046 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.212 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 5 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 5 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 5 root txt unknown /proc/5/exe 2023-07-29T16:46:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 8 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.214 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 8 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 8 root txt unknown /proc/8/exe 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:mm_percpu 9 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:mm_percpu 9 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:mm_percpu 9 root txt unknown /proc/9/exe 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 10 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 10 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 10 root txt unknown /proc/10/exe 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 12 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 12 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 12 root txt unknown /proc/12/exe 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_sched 13 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.216 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_sched 13 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:rcu_sched 13 root txt unknown /proc/13/exe 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:migration 14 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:migration 14 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:migration 14 root txt unknown /proc/14/exe 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 15 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 15 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 15 root txt unknown /proc/15/exe 2023-07-29T16:46:19.217 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/0 16 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/0 16 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/0 16 root txt unknown /proc/16/exe 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/1 17 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/1 17 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/1 17 root txt unknown /proc/17/exe 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 18 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 18 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.218 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 18 root txt unknown /proc/18/exe 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:migration 19 root txt unknown /proc/19/exe 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 20 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 20 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 20 root txt unknown /proc/20/exe 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 21 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.219 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 21 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 21 root txt unknown /proc/21/exe 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/2 23 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/2 23 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/2 23 root txt unknown /proc/23/exe 2023-07-29T16:46:19.220 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 24 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 24 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 24 root txt unknown /proc/24/exe 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:migration 25 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:migration 25 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:migration 25 root txt unknown /proc/25/exe 2023-07-29T16:46:19.221 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 26 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 26 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 26 root txt unknown /proc/26/exe 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 27 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 27 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 27 root txt unknown /proc/27/exe 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.222 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/3 29 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/3 29 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/3 29 root txt unknown /proc/29/exe 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 30 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 30 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 30 root txt unknown /proc/30/exe 2023-07-29T16:46:19.223 INFO:teuthology.orchestra.run.smithi151.stdout:migration 31 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:migration 31 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:migration 31 root txt unknown /proc/31/exe 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 32 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 32 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 32 root txt unknown /proc/32/exe 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 33 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 33 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.224 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 33 root txt unknown /proc/33/exe 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/4 35 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/4 35 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/4 35 root txt unknown /proc/35/exe 2023-07-29T16:46:19.225 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 36 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 36 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 36 root txt unknown /proc/36/exe 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:migration 37 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:migration 37 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:migration 37 root txt unknown /proc/37/exe 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 38 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 38 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.226 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 38 root txt unknown /proc/38/exe 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 39 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 39 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 39 root txt unknown /proc/39/exe 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/5 41 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.227 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/5 41 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/5 41 root txt unknown /proc/41/exe 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 42 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 42 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 42 root txt unknown /proc/42/exe 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:migration 43 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:migration 43 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:migration 43 root txt unknown /proc/43/exe 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 44 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 44 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 44 root txt unknown /proc/44/exe 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 45 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 45 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 45 root txt unknown /proc/45/exe 2023-07-29T16:46:19.229 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/6 47 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/6 47 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/6 47 root txt unknown /proc/47/exe 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 48 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 48 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.230 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 48 root txt unknown /proc/48/exe 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:migration 49 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:migration 49 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:migration 49 root txt unknown /proc/49/exe 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 50 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 50 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 50 root txt unknown /proc/50/exe 2023-07-29T16:46:19.231 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 51 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 51 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 51 root txt unknown /proc/51/exe 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/7 53 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/7 53 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:cpuhp/7 53 root txt unknown /proc/53/exe 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 54 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 54 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:watchdog/ 54 root txt unknown /proc/54/exe 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:migration 55 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:migration 55 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:migration 55 root txt unknown /proc/55/exe 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 56 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.233 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 56 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:ksoftirqd 56 root txt unknown /proc/56/exe 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 57 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 57 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 57 root txt unknown /proc/57/exe 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-07-29T16:46:19.234 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 60 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 60 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 60 root txt unknown /proc/60/exe 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.235 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-07-29T16:46:19.236 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kdevtmpfs 67 root cwd DIR 0,6 3380 3 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kdevtmpfs 67 root rtd DIR 0,6 3380 3 / 2023-07-29T16:46:19.237 INFO:teuthology.orchestra.run.smithi151.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:netns 68 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:netns 68 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:netns 68 root txt unknown /proc/68/exe 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:kauditd 69 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:kauditd 69 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:kauditd 69 root txt unknown /proc/69/exe 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 70 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.238 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 70 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 70 root txt unknown /proc/70/exe 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:khungtask 71 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:khungtask 71 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:khungtask 71 root txt unknown /proc/71/exe 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:oom_reape 72 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:oom_reape 72 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:oom_reape 72 root txt unknown /proc/72/exe 2023-07-29T16:46:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:writeback 73 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:writeback 73 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:writeback 73 root txt unknown /proc/73/exe 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:kcompactd 74 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:kcompactd 74 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:kcompactd 74 root txt unknown /proc/74/exe 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:ksmd 75 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:ksmd 75 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.240 INFO:teuthology.orchestra.run.smithi151.stdout:ksmd 75 root txt unknown /proc/75/exe 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:khugepage 76 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:khugepage 76 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:khugepage 76 root txt unknown /proc/76/exe 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:crypto 77 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:crypto 77 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:crypto 77 root txt unknown /proc/77/exe 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:kintegrit 78 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.241 INFO:teuthology.orchestra.run.smithi151.stdout:kintegrit 78 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:kintegrit 78 root txt unknown /proc/78/exe 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:kblockd 79 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:kblockd 79 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:kblockd 79 root txt unknown /proc/79/exe 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:blkcg_pun 80 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:blkcg_pun 80 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.242 INFO:teuthology.orchestra.run.smithi151.stdout:blkcg_pun 80 root txt unknown /proc/80/exe 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 81 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 81 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 81 root txt unknown /proc/81/exe 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 82 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 82 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 82 root txt unknown /proc/82/exe 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 83 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.243 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 83 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 83 root txt unknown /proc/83/exe 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 84 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 84 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 84 root txt unknown /proc/84/exe 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 85 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 85 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 85 root txt unknown /proc/85/exe 2023-07-29T16:46:19.244 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 86 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 86 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 86 root txt unknown /proc/86/exe 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:tpm_dev_w 87 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:tpm_dev_w 87 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:tpm_dev_w 87 root txt unknown /proc/87/exe 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:md 88 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.245 INFO:teuthology.orchestra.run.smithi151.stdout:md 88 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:md 88 root txt unknown /proc/88/exe 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.246 INFO:teuthology.orchestra.run.smithi151.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 91 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 91 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 91 root txt unknown /proc/91/exe 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kswapd0 124 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kswapd0 124 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kswapd0 124 root txt unknown /proc/124/exe 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kthrotld 226 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.247 INFO:teuthology.orchestra.run.smithi151.stdout:kthrotld 226 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:kthrotld 226 root txt unknown /proc/226/exe 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:acpi_ther 227 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:acpi_ther 227 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:acpi_ther 227 root txt unknown /proc/227/exe 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 228 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 228 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 228 root txt unknown /proc/228/exe 2023-07-29T16:46:19.248 INFO:teuthology.orchestra.run.smithi151.stdout:kmpath_rd 229 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kmpath_rd 229 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kmpath_rd 229 root txt unknown /proc/229/exe 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kaluad 230 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kaluad 230 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kaluad 230 root txt unknown /proc/230/exe 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 231 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 231 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.249 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 231 root txt unknown /proc/231/exe 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 232 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 232 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 232 root txt unknown /proc/232/exe 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:ipv6_addr 233 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:ipv6_addr 233 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:ipv6_addr 233 root txt unknown /proc/233/exe 2023-07-29T16:46:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:kstrp 234 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kstrp 234 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kstrp 234 root txt unknown /proc/234/exe 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 235 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 235 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 235 root txt unknown /proc/235/exe 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 294 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 294 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.251 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 294 root txt unknown /proc/294/exe 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 316 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 316 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 316 root txt unknown /proc/316/exe 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 348 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 348 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/2 348 root txt unknown /proc/348/exe 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 351 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.252 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 351 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 351 root txt unknown /proc/351/exe 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 352 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 352 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 352 root txt unknown /proc/352/exe 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 373 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 373 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 373 root txt unknown /proc/373/exe 2023-07-29T16:46:19.253 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 377 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 377 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 377 root txt unknown /proc/377/exe 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 378 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 378 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/3 378 root txt unknown /proc/378/exe 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 380 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 380 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.254 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 380 root txt unknown /proc/380/exe 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 476 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 476 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 476 root txt unknown /proc/476/exe 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 488 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 488 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 488 root txt unknown /proc/488/exe 2023-07-29T16:46:19.255 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 489 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 489 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/7 489 root txt unknown /proc/489/exe 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 495 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 495 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/6 495 root txt unknown /proc/495/exe 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-wq 503 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-wq 503 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-wq 503 root txt unknown /proc/503/exe 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-rese 504 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-rese 504 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-rese 504 root txt unknown /proc/504/exe 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-dele 505 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-dele 505 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:nvme-dele 505 root txt unknown /proc/505/exe 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:ata_sff 506 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:ata_sff 506 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:ata_sff 506 root txt unknown /proc/506/exe 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_0 512 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_0 512 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_0 512 root txt unknown /proc/512/exe 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 513 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 513 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 513 root txt unknown /proc/513/exe 2023-07-29T16:46:19.258 INFO:teuthology.orchestra.run.smithi151.stdout:ixgbe 514 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:ixgbe 514 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:ixgbe 514 root txt unknown /proc/514/exe 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_1 515 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_1 515 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_1 515 root txt unknown /proc/515/exe 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 516 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 516 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 516 root txt unknown /proc/516/exe 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_2 517 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_2 517 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_2 517 root txt unknown /proc/517/exe 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 518 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 518 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 518 root txt unknown /proc/518/exe 2023-07-29T16:46:19.260 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_3 519 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_3 519 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_3 519 root txt unknown /proc/519/exe 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 520 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 520 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 520 root txt unknown /proc/520/exe 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_4 521 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_4 521 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.261 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_4 521 root txt unknown /proc/521/exe 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 522 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 522 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 522 root txt unknown /proc/522/exe 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_5 523 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_5 523 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_5 523 root txt unknown /proc/523/exe 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 524 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.262 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 524 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.263 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 524 root txt unknown /proc/524/exe 2023-07-29T16:46:19.263 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_6 525 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.263 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_6 525 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.264 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_6 525 root txt unknown /proc/525/exe 2023-07-29T16:46:19.264 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 526 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.264 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 526 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.264 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 526 root txt unknown /proc/526/exe 2023-07-29T16:46:19.265 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_7 527 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.265 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_7 527 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.265 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_7 527 root txt unknown /proc/527/exe 2023-07-29T16:46:19.266 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 528 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.266 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 528 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.266 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 528 root txt unknown /proc/528/exe 2023-07-29T16:46:19.266 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_8 529 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.267 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_8 529 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.267 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_8 529 root txt unknown /proc/529/exe 2023-07-29T16:46:19.267 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 530 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.268 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 530 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.268 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 530 root txt unknown /proc/530/exe 2023-07-29T16:46:19.268 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_9 531 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.268 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_9 531 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.269 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_eh_9 531 root txt unknown /proc/531/exe 2023-07-29T16:46:19.269 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 532 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.269 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 532 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.270 INFO:teuthology.orchestra.run.smithi151.stdout:scsi_tmf_ 532 root txt unknown /proc/532/exe 2023-07-29T16:46:19.270 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 535 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.270 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 535 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.270 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 535 root txt unknown /proc/535/exe 2023-07-29T16:46:19.271 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 536 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.271 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 536 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.271 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 536 root txt unknown /proc/536/exe 2023-07-29T16:46:19.271 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 537 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.271 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 537 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.272 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 537 root txt unknown /proc/537/exe 2023-07-29T16:46:19.272 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 551 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.272 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 551 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 551 root txt unknown /proc/551/exe 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:jbd2/sda1 565 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:jbd2/sda1 565 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:jbd2/sda1 565 root txt unknown /proc/565/exe 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:ext4-rsv- 566 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.273 INFO:teuthology.orchestra.run.smithi151.stdout:ext4-rsv- 566 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:ext4-rsv- 566 root txt unknown /proc/566/exe 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 598 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 598 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 598 root txt unknown /proc/598/exe 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 636 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 636 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.274 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 636 root txt unknown /proc/636/exe 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root txt REG 8,1 153992 8126 /usr/lib/systemd/systemd-journald 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.276 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.277 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.278 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root mem REG 0,24 8 17443 /run/systemd/journal/kernel-seqnum 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.279 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 2w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 3u unix 0xffff9fae0097a880 0t0 15484 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 4u unix 0xffff9fae00979680 0t0 15487 /run/systemd/journal/socket type=DGRAM 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 5u unix 0xffff9fae0097bf00 0t0 15479 /run/systemd/journal/dev-log type=DGRAM 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 6u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 7u CHR 1,11 0t0 3081 /dev/kmsg 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 8r REG 0,5 0 17444 /proc/sys/kernel/hostname 2023-07-29T16:46:19.280 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 9u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 10u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 11u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 12u unix 0xffff9fae00ba9f80 0t0 17949 type=DGRAM 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 13u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 14u REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 15u unix 0xffff9fae00b6f080 0t0 14022 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.281 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 16u unix 0xffff9fadc94dd580 0t0 46227 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 17u unix 0xffff9fae00b59680 0t0 28210 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 18u unix 0xffff9fae0097ba80 0t0 18085 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 19u unix 0xffff9fadc9570d80 0t0 20909 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 20u unix 0xffff9fadc9577980 0t0 22596 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 21u unix 0xffff9fae00b6e780 0t0 28018 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 22u unix 0xffff9fadc94dba80 0t0 19260 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.282 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 23u unix 0xffff9fae00ba9680 0t0 20988 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 24u unix 0xffff9fae00b5da00 0t0 20990 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 25u unix 0xffff9fae00b5a400 0t0 22610 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 26u unix 0xffff9fae00b58480 0t0 22612 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 27u unix 0xffff9fadc957e780 0t0 20911 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 28u unix 0xffff9fadc94dcc80 0t0 27954 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 29u unix 0xffff9fadc957f980 0t0 27956 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.283 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 30u unix 0xffff9fadc957da00 0t0 27958 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 32u unix 0xffff9fae00b6f500 0t0 20994 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 34u unix 0xffff9fae00ba8d80 0t0 31881 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-j 662 root 35u unix 0xffff9fae00a1a880 0t0 21046 /run/systemd/journal/stdout type=STREAM 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:ext4lazyi 674 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:ext4lazyi 674 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:ext4lazyi 674 root txt unknown /proc/674/exe 2023-07-29T16:46:19.284 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 697 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 697 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/4 697 root txt unknown /proc/697/exe 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root txt REG 8,1 418304 8317 /usr/lib/systemd/systemd-udevd 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.285 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 559522 41419 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.symbols.bin 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 871129 41679 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.alias.bin 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.286 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.287 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.288 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.289 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 442609 41424 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.dep.bin 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 576141 25076 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T16:46:19.290 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 10109 41420 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.builtin.bin 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 1u unix 0xffff9fae0097f500 0t0 20130 type=STREAM 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 2u unix 0xffff9fae0097f500 0t0 20130 type=STREAM 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 3u netlink 0t0 20486 KOBJECT_UEVENT 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 4u unix 0xffff9fadc94da880 0t0 20487 /run/udev/control type=SEQPACKET 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 5u unix 0xffff9fae00ba9200 0t0 18090 type=DGRAM 2023-07-29T16:46:19.291 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 6r REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 7u unix 0xffff9fae00a18000 0t0 17131 type=DGRAM 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 8r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 9r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 10u unix 0xffff9fae00a19680 0t0 17132 type=DGRAM 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 11r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 12u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 13u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 14u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-u 707 root 15u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc txt REG 8,1 63160 14085 /usr/bin/rpcbind 2023-07-29T16:46:19.293 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.294 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.295 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.296 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 1u unix 0xffff9fae00b6d100 0t0 19165 type=STREAM 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 2u unix 0xffff9fae00b6d100 0t0 19165 type=STREAM 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 3u unix 0xffff9fadc9571f80 0t0 327 /run/rpcbind.sock type=STREAM 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 4u IPv4 330 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 5u IPv4 331 0t0 UDP *:sunrpc 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 6u IPv6 332 0t0 TCP *:sunrpc (LISTEN) 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 7u IPv6 333 0t0 UDP *:sunrpc 2023-07-29T16:46:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:rpcbind 748 rpc 8rW REG 0,24 0 14081 /run/rpcbind/rpcbind.lock 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.299 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.300 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.301 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.302 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.302 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-07-29T16:46:19.302 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.302 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 3u netlink 0t0 14087 AUDIT 2023-07-29T16:46:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 4r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.304 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.304 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 6w REG 8,1 5643648 66436 /var/log/audit/audit.log 2023-07-29T16:46:19.304 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 7u unix 0xffff9fadc957b600 0t0 14091 type=DGRAM 2023-07-29T16:46:19.304 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 8u unix 0xffff9fadc957cc80 0t0 14090 type=STREAM 2023-07-29T16:46:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 9u unix 0xffff9fadc9578d80 0t0 14092 type=STREAM 2023-07-29T16:46:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 10u unix 0xffff9fadc9578000 0t0 14093 type=STREAM 2023-07-29T16:46:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.305 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 root 12u unix 0xffff9fae00baad00 0t0 34276 type=STREAM 2023-07-29T16:46:19.306 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.306 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.306 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-07-29T16:46:19.306 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.307 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.307 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.307 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.307 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.307 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.308 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.309 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 3u netlink 0t0 14087 AUDIT 2023-07-29T16:46:19.310 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 4r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 6w REG 8,1 5643648 66436 /var/log/audit/audit.log 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 7u unix 0xffff9fadc957b600 0t0 14091 type=DGRAM 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 8u unix 0xffff9fadc957cc80 0t0 14090 type=STREAM 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 9u unix 0xffff9fadc9578d80 0t0 14092 type=STREAM 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 10u unix 0xffff9fadc9578000 0t0 14093 type=STREAM 2023-07-29T16:46:19.311 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 753 auditd root 12u unix 0xffff9fae00baad00 0t0 34276 type=STREAM 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.312 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.313 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.314 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.315 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 3u netlink 0t0 14087 AUDIT 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 4r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 6w REG 8,1 5643648 66436 /var/log/audit/audit.log 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 7u unix 0xffff9fadc957b600 0t0 14091 type=DGRAM 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 8u unix 0xffff9fadc957cc80 0t0 14090 type=STREAM 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 9u unix 0xffff9fadc9578d80 0t0 14092 type=STREAM 2023-07-29T16:46:19.316 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 10u unix 0xffff9fadc9578000 0t0 14093 type=STREAM 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:auditd 752 758 auditd root 12u unix 0xffff9fae00baad00 0t0 34276 type=STREAM 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:rpciod 754 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:rpciod 754 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:rpciod 754 root txt unknown /proc/754/exe 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 755 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 755 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.317 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/u 755 root txt unknown /proc/755/exe 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:xprtiod 756 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:xprtiod 756 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:xprtiod 756 root txt unknown /proc/756/exe 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root txt REG 8,1 21008 10285 /usr/sbin/sedispatch 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.318 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.319 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.320 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root 0u unix 0xffff9fadc957f500 0t0 14089 type=STREAM 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.321 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root 3u unix 0xffff9fae42ff1f80 0t0 38586 type=STREAM 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:sedispatc 757 root 4u unix 0xffff9fae0097c800 0t0 41178 type=DGRAM 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 777 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 777 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 777 root txt unknown /proc/777/exe 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 778 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 778 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 778 root txt unknown /proc/778/exe 2023-07-29T16:46:19.322 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 779 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 779 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 779 root txt unknown /proc/779/exe 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 780 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 780 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 780 root txt unknown /proc/780/exe 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 781 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 781 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.323 INFO:teuthology.orchestra.run.smithi151.stdout:kdmflush/ 781 root txt unknown /proc/781/exe 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kipmi0 790 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kipmi0 790 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kipmi0 790 root txt unknown /proc/790/exe 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 844 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 844 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/1 844 root txt unknown /proc/844/exe 2023-07-29T16:46:19.324 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi cwd DIR 8,1 4096 1974 /etc/avahi 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi rtd DIR 8,1 4096 1974 /etc/avahi 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.325 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.327 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-07-29T16:46:19.328 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-07-29T16:46:19.337 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.337 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.337 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 1u unix 0xffff9fadc9572880 0t0 810 type=STREAM 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 2u unix 0xffff9fadc9572880 0t0 810 type=STREAM 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 3u unix 0xffff9fae00b5c800 0t0 1796 /run/avahi-daemon/socket type=STREAM 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 4r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 5r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 6u unix 0xffff9fae00b6da00 0t0 19341 type=DGRAM 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 7r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.338 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 8u unix 0xffff9fae00a1b600 0t0 22720 type=STREAM 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 9r FIFO 0,13 0t0 22723 pipe 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 10w FIFO 0,13 0t0 22723 pipe 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 11r FIFO 0,13 0t0 22724 pipe 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 12w FIFO 0,13 0t0 22724 pipe 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 13u unix 0xffff9fae00a1ba80 0t0 22725 type=STREAM 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 14r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 15u IPv4 30882 0t0 UDP *:mdns 2023-07-29T16:46:19.339 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 16u IPv6 30883 0t0 UDP *:mdns 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 17u IPv4 30884 0t0 UDP *:54979 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 18u IPv6 30885 0t0 UDP *:45286 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 847 avahi 19u netlink 0t0 30886 ROUTE 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.340 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.341 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.344 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.345 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.346 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.346 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.346 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.347 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.347 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.347 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.348 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.349 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.350 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.350 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.350 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.350 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.350 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.351 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.351 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.351 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.351 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.352 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.352 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.352 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.352 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.353 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.354 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.355 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.356 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.357 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 965 gmain polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.359 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.361 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.362 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.363 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.364 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.365 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 966 gdbus polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.367 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.368 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.370 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.371 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.373 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.374 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 975 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.375 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.376 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.377 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.377 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.377 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.377 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.379 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.379 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.380 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.380 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.380 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.380 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.381 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.382 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.383 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 976 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.386 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.387 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.388 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.389 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.390 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.391 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.392 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 977 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.393 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.394 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.395 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.398 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 978 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.401 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.402 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.403 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.405 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.407 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 979 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.410 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.411 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.412 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.413 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.414 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.415 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.416 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 980 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.417 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.418 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.420 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.421 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.422 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.423 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.424 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 981 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.426 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.428 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.429 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.430 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.431 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 982 JS\x20Hel polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-07-29T16:46:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.436 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.437 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.440 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 4r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.441 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 8u unix 0xffff9fae00b5ec00 0t0 1963 type=STREAM 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 9u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 11u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:polkitd 849 990 polkitd polkitd 12u unix 0xffff9fae00b6d580 0t0 31103 type=DGRAM 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-07-29T16:46:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.443 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-07-29T16:46:19.444 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 1u unix 0xffff9fadc94d8d80 0t0 20876 type=STREAM 2023-07-29T16:46:19.445 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 2u unix 0xffff9fadc94d8d80 0t0 20876 type=STREAM 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 3u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 root 5u unix 0xffff9fae00b68900 0t0 19330 @irqbalance852.sock type=STREAM 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-07-29T16:46:19.446 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.447 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-07-29T16:46:19.448 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 1u unix 0xffff9fadc94d8d80 0t0 20876 type=STREAM 2023-07-29T16:46:19.449 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 2u unix 0xffff9fadc94d8d80 0t0 20876 type=STREAM 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 3u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:irqbalanc 852 871 gmain root 5u unix 0xffff9fae00b68900 0t0 19330 @irqbalance852.sock type=STREAM 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root txt REG 8,1 718504 11142 /usr/sbin/smartd 2023-07-29T16:46:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.451 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.452 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:smartd 853 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.453 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.454 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.455 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.457 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph 1u unix 0xffff9fae00b58000 0t0 1872 type=STREAM 2023-07-29T16:46:19.458 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph 2u unix 0xffff9fae00b58000 0t0 1872 type=STREAM 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-cras 856 ceph 4r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root txt REG 8,1 83544 10536 /usr/sbin/sssd 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.459 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-07-29T16:46:19.460 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-07-29T16:46:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.462 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.463 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.464 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.465 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-07-29T16:46:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-07-29T16:46:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-07-29T16:46:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 147336 5439 /usr/lib64/libnl-3.so.200.26.0 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 549824 5447 /usr/lib64/libnl-route-3.so.200.26.0 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.469 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.470 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 0r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 1u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 2u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.471 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 3w REG 8,1 13873 66780 /var/log/sssd/sssd.log 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 5u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 7u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 8u unix 0xffff9fae00b6e300 0t0 31101 type=DGRAM 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 9u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 10u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 11u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 12u unix 0xffff9fae00b69200 0t0 31105 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 13u unix 0xffff9fae00b6ad00 0t0 31106 type=STREAM 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 14u unix 0xffff9fae00b68480 0t0 31107 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 15r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 16r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.473 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 17u netlink 0t0 29732 ROUTE 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 18u unix 0xffff9fadc9575e80 0t0 29777 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:sssd 857 root 19u unix 0xffff9fadc9570900 0t0 22480 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfsalloc 858 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfsalloc 858 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfsalloc 858 root txt unknown /proc/858/exe 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfs_mru_c 859 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfs_mru_c 859 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.474 INFO:teuthology.orchestra.run.smithi151.stdout:xfs_mru_c 859 root txt unknown /proc/859/exe 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-buf/d 860 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-buf/d 860 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-buf/d 860 root txt unknown /proc/860/exe 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-conv/ 861 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-conv/ 861 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-conv/ 861 root txt unknown /proc/861/exe 2023-07-29T16:46:19.475 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-cil/d 862 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-cil/d 862 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-cil/d 862 root txt unknown /proc/862/exe 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-recla 863 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-recla 863 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-recla 863 root txt unknown /proc/863/exe 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-block 864 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.476 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-block 864 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-block 864 root txt unknown /proc/864/exe 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-log/d 865 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-log/d 865 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfs-log/d 865 root txt unknown /proc/865/exe 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfsaild/d 866 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfsaild/d 866 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:xfsaild/d 866 root txt unknown /proc/866/exe 2023-07-29T16:46:19.477 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root txt REG 8,1 185992 11073 /usr/sbin/mcelog 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.478 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 1u unix 0xffff9fadc9577500 0t0 1011 type=STREAM 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 2u unix 0xffff9fadc9577500 0t0 1011 type=STREAM 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 3r CHR 10,227 0t0 13305 /dev/mcelog 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 4r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:mcelog 935 root 5u unix 0xffff9fadc9576300 0t0 29711 /var/run/mcelog-client type=STREAM 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.479 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.480 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.481 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.482 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 1u unix 0xffff9fadc9579f80 0t0 14334 type=STREAM 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 2u unix 0xffff9fadc9579f80 0t0 14334 type=STREAM 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 3u unix 0xffff9fae00b5ba80 0t0 1792 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.483 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 5u unix 0xffff9faf80653a80 0t0 42367 type=STREAM 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 7u sock 0,9 0t0 28001 protocol: NETLINK 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 8r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 9u netlink 0t0 28002 SELINUX 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 11u unix 0xffff9fae00bada00 0t0 28007 type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 12u unix 0xffff9fae00bae300 0t0 28008 type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 13u unix 0xffff9fae00a1c800 0t0 28017 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 14u unix 0xffff9fadc9574c80 0t0 28010 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 15u unix 0xffff9fae00b5d580 0t0 28029 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 16u unix 0xffff9fae0097e300 0t0 28030 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 17u unix 0xffff9fae0097b180 0t0 22308 type=DGRAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 18u unix 0xffff9fae42ff6300 0t0 37378 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.485 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 20u unix 0xffff9fadc957ec00 0t0 31114 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 21u unix 0xffff9fadc94df980 0t0 42366 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 22u unix 0xffff9fae00b5f980 0t0 22499 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 23u unix 0xffff9fadc9571680 0t0 28856 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 dbus 24u unix 0xffff9fae00b6a400 0t0 28858 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-07-29T16:46:19.486 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.487 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.488 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.489 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 1u unix 0xffff9fadc9579f80 0t0 14334 type=STREAM 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 2u unix 0xffff9fadc9579f80 0t0 14334 type=STREAM 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 3u unix 0xffff9fae00b5ba80 0t0 1792 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 5u unix 0xffff9faf80653a80 0t0 42367 type=STREAM 2023-07-29T16:46:19.490 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 7u sock 0,9 0t0 28001 protocol: NETLINK 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 8r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 9u netlink 0t0 28002 SELINUX 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 11u unix 0xffff9fae00bada00 0t0 28007 type=STREAM 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 12u unix 0xffff9fae00bae300 0t0 28008 type=STREAM 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 13u unix 0xffff9fae00a1c800 0t0 28017 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.491 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 14u unix 0xffff9fadc9574c80 0t0 28010 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 15u unix 0xffff9fae00b5d580 0t0 28029 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 16u unix 0xffff9fae0097e300 0t0 28030 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 17u unix 0xffff9fae0097b180 0t0 22308 type=DGRAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 18u unix 0xffff9fae42ff6300 0t0 37378 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 20u unix 0xffff9fadc957ec00 0t0 31114 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 21u unix 0xffff9fadc94df980 0t0 42366 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 22u unix 0xffff9fae00b5f980 0t0 22499 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 23u unix 0xffff9fadc9571680 0t0 28856 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:dbus-daem 937 953 dbus-daem dbus 24u unix 0xffff9fae00b6a400 0t0 28858 /run/dbus/system_bus_socket type=STREAM 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T16:46:19.493 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.495 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.496 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.499 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.500 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.501 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.502 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 1u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 2u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 3u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.504 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 5u unix 0xffff9fae00978900 0t0 22293 type=DGRAM 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 6u unix 0xffff9fae00979f80 0t0 22294 type=STREAM 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 8r REG 0,4 0 4026532000 net 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 9r REG 0,4 0 4026532493 mnt 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 10u netlink 0t0 1967 KOBJECT_UEVENT 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 11u netlink 0t0 1968 GENERIC 2023-07-29T16:46:19.505 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 12u netlink 0t0 1969 ROUTE 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 13r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 14r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 15r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 17u unix 0xffff9fadc957b180 0t0 28785 type=STREAM 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 18u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 19u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.506 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 20u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 21u pack 28386 0t0 IP type=SOCK_DGRAM 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 22u raw6 0t0 21141 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 23w FIFO 0,24 0t0 22513 /run/systemd/inhibit/1.ref 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 root 27u IPv4 34336 0t0 UDP smithi151.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-07-29T16:46:19.507 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.508 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.509 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.510 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.511 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.513 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.514 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.516 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.517 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 1u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.518 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 2u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 3u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 5u unix 0xffff9fae00978900 0t0 22293 type=DGRAM 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 6u unix 0xffff9fae00979f80 0t0 22294 type=STREAM 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 8r REG 0,4 0 4026532000 net 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 9r REG 0,4 0 4026532493 mnt 2023-07-29T16:46:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 10u netlink 0t0 1967 KOBJECT_UEVENT 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 11u netlink 0t0 1968 GENERIC 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 12u netlink 0t0 1969 ROUTE 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 13r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 14r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 15r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T16:46:19.520 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 17u unix 0xffff9fadc957b180 0t0 28785 type=STREAM 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 18u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 19u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 20u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 21u pack 28386 0t0 IP type=SOCK_DGRAM 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 22u raw6 0t0 21141 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 23w FIFO 0,24 0t0 22513 /run/systemd/inhibit/1.ref 2023-07-29T16:46:19.521 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 964 gmain root 27u IPv4 34336 0t0 UDP smithi151.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-07-29T16:46:19.522 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.524 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.525 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.526 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.527 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.528 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.529 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.530 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.531 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.532 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 1u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 2u unix 0xffff9fadc94d9b00 0t0 20972 type=STREAM 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 3u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 5u unix 0xffff9fae00978900 0t0 22293 type=DGRAM 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 6u unix 0xffff9fae00979f80 0t0 22294 type=STREAM 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 8r REG 0,4 0 4026532000 net 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 9r REG 0,4 0 4026532493 mnt 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 10u netlink 0t0 1967 KOBJECT_UEVENT 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 11u netlink 0t0 1968 GENERIC 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 12u netlink 0t0 1969 ROUTE 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 13r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 14r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 15r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.534 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 16u netlink 0t0 28109 KOBJECT_UEVENT 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 17u unix 0xffff9fadc957b180 0t0 28785 type=STREAM 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 18u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 19u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 20u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 21u pack 28386 0t0 IP type=SOCK_DGRAM 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 22u raw6 0t0 21141 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-07-29T16:46:19.535 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 23w FIFO 0,24 0t0 22513 /run/systemd/inhibit/1.ref 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:NetworkMa 938 967 gdbus root 27u IPv4 34336 0t0 UDP smithi151.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt txt REG 8,1 25472 9470 /usr/bin/lsmd 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.536 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt mem REG 8,1 54680 6239 /usr/lib64/libconfig.so.9.2.0 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 1u unix 0xffff9fadc9579680 0t0 28731 type=STREAM 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 2u unix 0xffff9fadc957e300 0t0 28732 type=STREAM 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 3uW REG 0,24 0 30721 /run/lsm/ipc/.lsmd-ipc-lock 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 4r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.537 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 5u unix 0xffff9fae00b68d80 0t0 30722 /var/run/lsm/ipc/sim type=STREAM 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:lsmd 939 libstoragemgmt 6u unix 0xffff9fae00b6ba80 0t0 30724 /var/run/lsm/ipc/simc type=STREAM 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony txt REG 8,1 351352 11027 /usr/sbin/chronyd 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.538 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 695184 7235 /usr/lib64/libnss_myhostname.so.2 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 29256 4996 /usr/lib64/libnss_dns-2.28.so 2023-07-29T16:46:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.540 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.541 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 3u unix 0xffff9fae00b6ec00 0t0 19444 type=DGRAM 2023-07-29T16:46:19.542 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 5r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 6u IPv4 19452 0t0 UDP localhost:323 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 7u IPv6 19453 0t0 UDP localhost:323 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:chronyd 948 chrony 8u unix 0xffff9fae00b6b180 0t0 19454 /run/chrony/chronyd.sock type=DGRAM 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.543 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.544 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 1u unix 0xffff9fadc9572880 0t0 810 type=STREAM 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 2u unix 0xffff9fadc9572880 0t0 810 type=STREAM 2023-07-29T16:46:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 3u unix 0xffff9fae00b5c800 0t0 1796 /run/avahi-daemon/socket type=STREAM 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 4r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 5r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 6u unix 0xffff9fae00b6da00 0t0 19341 type=DGRAM 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 7r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:avahi-dae 955 avahi 9u unix 0xffff9fae00a1cc80 0t0 22721 type=STREAM 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 958 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 958 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.548 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/5 958 root txt unknown /proc/958/exe 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root txt REG 8,1 1150584 5025 /usr/bin/bash 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.549 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.550 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.551 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root 1u unix 0xffff9fae00b69f80 0t0 30881 type=STREAM 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root 2u unix 0xffff9fae00b69f80 0t0 30881 type=STREAM 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:ksmtuned 962 root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.552 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 0,14 12460 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.553 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.554 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.555 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.556 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.557 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T16:46:19.558 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.559 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.561 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.562 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.563 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.564 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 1u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 2u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 4w REG 8,1 32030 66484 /var/log/tuned/tuned.log 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 5u netlink 0t0 28206 KOBJECT_UEVENT 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 6u unix 0xffff9fadc9576780 0t0 29882 type=STREAM 2023-07-29T16:46:19.565 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 8w CHR 10,62 0t0 13308 /dev/cpu_dma_latency 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 9u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 10u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 11u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 12u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 13u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.566 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 14u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 15u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 16u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 17r FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 18w FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 20u unix 0xffff9fae00b5cc80 0t0 32076 type=STREAM 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 root 21u unix 0xffff9fae00b5f500 0t0 32077 type=STREAM 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.567 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 0,14 12460 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.568 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.569 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T16:46:19.571 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.572 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.573 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.576 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.577 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.578 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 1u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 2u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 4w REG 8,1 32030 66484 /var/log/tuned/tuned.log 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 5u netlink 0t0 28206 KOBJECT_UEVENT 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 6u unix 0xffff9fadc9576780 0t0 29882 type=STREAM 2023-07-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 8w CHR 10,62 0t0 13308 /dev/cpu_dma_latency 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 9u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 10u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 11u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 12u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 13u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.581 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 14u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 15u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 16u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 17r FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 18w FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 20u unix 0xffff9fae00b5cc80 0t0 32076 type=STREAM 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1197 tuned root 21u unix 0xffff9fae00b5f500 0t0 32077 type=STREAM 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.582 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 0,14 12460 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.583 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.585 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T16:46:19.586 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.588 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.589 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.590 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.594 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 1u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 2u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 4w REG 8,1 32030 66484 /var/log/tuned/tuned.log 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 5u netlink 0t0 28206 KOBJECT_UEVENT 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 6u unix 0xffff9fadc9576780 0t0 29882 type=STREAM 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.595 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 8w CHR 10,62 0t0 13308 /dev/cpu_dma_latency 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 9u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 10u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 11u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 12u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 13u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 14u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.596 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 15u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 16u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 17r FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 18w FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 20u unix 0xffff9fae00b5cc80 0t0 32076 type=STREAM 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1206 tuned root 21u unix 0xffff9fae00b5f500 0t0 32077 type=STREAM 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.597 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 0,14 12460 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.598 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.599 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.600 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.601 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.602 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.603 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.604 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.605 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.606 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.607 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.608 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.609 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 1u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 2u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 4w REG 8,1 32030 66484 /var/log/tuned/tuned.log 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 5u netlink 0t0 28206 KOBJECT_UEVENT 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 6u unix 0xffff9fadc9576780 0t0 29882 type=STREAM 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 8w CHR 10,62 0t0 13308 /dev/cpu_dma_latency 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 9u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 10u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 11u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 12u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 13u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 14u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 15u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.611 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 16u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 17r FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 18w FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 20u unix 0xffff9fae00b5cc80 0t0 32076 type=STREAM 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1229 tuned root 21u unix 0xffff9fae00b5f500 0t0 32077 type=STREAM 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-07-29T16:46:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 0,14 12460 anon_inode:[perf_event] (stat: No such file or directory) 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.613 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.614 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.615 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.616 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.619 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.621 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-07-29T16:46:19.622 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.623 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.624 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 1u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 2u unix 0xffff9fae00bae780 0t0 28101 type=STREAM 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 4w REG 8,1 32030 66484 /var/log/tuned/tuned.log 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 5u netlink 0t0 28206 KOBJECT_UEVENT 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 6u unix 0xffff9fadc9576780 0t0 29882 type=STREAM 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 7u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 8w CHR 10,62 0t0 13308 /dev/cpu_dma_latency 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 9u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 10u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 11u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 12u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 13u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 14u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 15u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.626 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 16u a_inode 0,14 0 12460 [perf_event] 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 17r FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 18w FIFO 0,13 0t0 28432 pipe 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 20u unix 0xffff9fae00b5cc80 0t0 32076 type=STREAM 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:tuned 969 1230 tuned root 21u unix 0xffff9fae00b5f500 0t0 32077 type=STREAM 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-07-29T16:46:19.627 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root DEL REG 8,1 67911 /var/lib/sss/mc/group 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.628 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.630 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.631 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 1u unix 0xffff9fae00b58900 0t0 2039 type=STREAM 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 2u unix 0xffff9fae00b58900 0t0 2039 type=STREAM 2023-07-29T16:46:19.632 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 3r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 4u IPv4 31780 0t0 TCP *:ssh (LISTEN) 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 5r REG 8,1 6940392 67911 /var/lib/sss/mc/group (deleted) 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 970 root 6u IPv6 31782 0t0 TCP *:ssh (LISTEN) 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root txt REG 8,1 25704 10732 /usr/bin/rhsmcertd 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.634 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.636 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.637 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root 3wW REG 0,24 0 22306 /run/lock/subsys/rhsmcertd 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:rhsmcertd 973 root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.638 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.639 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.640 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.642 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.643 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.644 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.645 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.646 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.647 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.648 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.649 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.650 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 992 gssproxy root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.651 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.652 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.653 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.654 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.655 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.656 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.657 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 993 gssproxy root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.658 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.659 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.661 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.662 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.663 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.664 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 994 gssproxy root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.665 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.666 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.667 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.669 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.670 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 995 gssproxy root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.672 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.673 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-07-29T16:46:19.674 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.675 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.676 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.677 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 1u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 2u unix 0xffff9fae00b6c800 0t0 31098 type=STREAM 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 3u unix 0xffff9fae00baa400 0t0 28105 type=DGRAM 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 4r FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 6r FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.678 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 7w FIFO 0,13 0t0 28110 pipe 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 8u unix 0xffff9fae00baf080 0t0 28111 /var/lib/gssproxy/default.sock type=STREAM 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 9u unix 0xffff9fae00bad100 0t0 28112 /run/gssproxy.sock type=STREAM 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:gssproxy 987 996 gssproxy root 10w FIFO 0,13 0t0 28116 pipe 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root txt REG 8,1 237976 50943 /usr/libexec/sssd/sssd_be 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 68288 8465 /usr/lib64/libsss_certmap.so.0.2.0 2023-07-29T16:46:19.679 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 58096 32121 /usr/lib64/sssd/libsss_files.so 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root DEL REG 8,1 67910 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root DEL REG 8,1 67733 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.680 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-07-29T16:46:19.681 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-07-29T16:46:19.682 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.683 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.684 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.686 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.688 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.689 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 79176 6499 /usr/lib64/libcares.so.2.2.0 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.690 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.691 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 0w REG 8,1 208781 66778 /var/log/sssd/sssd_implicit_files.log 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 1u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 2u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 3u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.692 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 8r FIFO 0,13 0t0 28119 pipe 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 9w FIFO 0,13 0t0 28119 pipe 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 10u unix 0xffff9fae00ba9b00 0t0 28120 type=DGRAM 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 11u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.693 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 12u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 13u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 14u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 15u unix 0xffff9fae00baf980 0t0 28121 /var/lib/sss/pipes/private/sbus-dp_implicit_files.997 type=STREAM 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 16u unix 0xffff9fae00baf500 0t0 28122 type=STREAM 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 17u unix 0xffff9fae00baba80 0t0 28123 /var/lib/sss/pipes/private/sbus-dp_implicit_files.997 type=STREAM 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 18r REG 8,1 9253600 67733 /var/lib/sss/mc/passwd (deleted) 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 19r REG 8,1 11567160 67910 /var/lib/sss/mc/initgroups (deleted) 2023-07-29T16:46:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 20r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 21r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 22u unix 0xffff9fadc9573180 0t0 29776 type=STREAM 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_be 997 root 23u unix 0xffff9fadc9573600 0t0 28803 /var/lib/sss/pipes/private/sbus-dp_implicit_files.997 type=STREAM 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root txt REG 8,1 305856 50945 /usr/libexec/sssd/sssd_nss 2023-07-29T16:46:19.695 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem-w REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem-w REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem-w REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-07-29T16:46:19.696 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-07-29T16:46:19.697 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.699 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.701 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-07-29T16:46:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-07-29T16:46:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-07-29T16:46:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 28888 5451 /usr/lib64/libsss_idmap.so.0.5.1 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.706 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 0w REG 8,1 331012 66816 /var/log/sssd/sssd_nss.log 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 1u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 2u unix 0xffff9fae00b5c380 0t0 1932 type=STREAM 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 3u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.707 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 4u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 5u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 8r FIFO 0,13 0t0 29780 pipe 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 9w FIFO 0,13 0t0 29780 pipe 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 10u unix 0xffff9fadc9572400 0t0 29781 type=DGRAM 2023-07-29T16:46:19.708 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 11u unix 0xffff9fadc9575100 0t0 29782 type=STREAM 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 12u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 13u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 14u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 15u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 16u unix 0xffff9fadc9576c00 0t0 29806 /var/lib/sss/pipes/nss type=STREAM 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 17uw REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.709 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 18uw REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 19uw REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 20u unix 0xffff9fadc9575580 0t0 29807 type=STREAM 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 21u unix 0xffff9fae00bab180 0t0 35698 /var/lib/sss/pipes/nss type=STREAM 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 22u unix 0xffff9fadc94d9200 0t0 35702 /var/lib/sss/pipes/nss type=STREAM 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 23u unix 0xffff9faf80654800 0t0 35703 /var/lib/sss/pipes/nss type=STREAM 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:sssd_nss 1031 root 24u unix 0xffff9fae00b59f80 0t0 35727 /var/lib/sss/pipes/nss type=STREAM 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.710 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root txt REG 8,1 259272 8128 /usr/lib/systemd/systemd-logind 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.711 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.714 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 576141 25076 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.715 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 1u unix 0xffff9fae00b5e780 0t0 31880 type=STREAM 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 2u unix 0xffff9fae00b5e780 0t0 31880 type=STREAM 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 3u unix 0xffff9fae00b5f080 0t0 31883 type=DGRAM 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 5u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 6u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 7r REG 0,21 4096 22183 /sys/devices/virtual/tty/tty0/active 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 8u netlink 0t0 31889 KOBJECT_UEVENT 2023-07-29T16:46:19.716 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 9u netlink 0t0 31890 KOBJECT_UEVENT 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 10u netlink 0t0 31891 KOBJECT_UEVENT 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 11u netlink 0t0 31892 KOBJECT_UEVENT 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 12u unix 0xffff9fae00b59b00 0t0 31893 type=STREAM 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 13u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 14u CHR 13,65 0t0 13303 /dev/input/event1 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 15u CHR 13,64 0t0 13302 /dev/input/event0 2023-07-29T16:46:19.717 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 16u CHR 13,66 0t0 17485 /dev/input/event2 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 17u CHR 4,6 0t0 3094 /dev/tty6 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 18r FIFO 0,24 0t0 22513 /run/systemd/inhibit/1.ref 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 19r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:systemd-l 1040 root 20r FIFO 0,24 0t0 46235 /run/systemd/sessions/1.ref 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root txt REG 8,1 467608 14012 /usr/sbin/cupsd 2023-07-29T16:46:19.718 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.720 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.721 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-07-29T16:46:19.722 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.723 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 629504 8599 /usr/lib64/libcups.so.2 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 74352 8596 /usr/lib64/libavahi-client.so.3.2.9 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 28936 8602 /usr/lib64/libcupsmime.so.1 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.725 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 1u unix 0xffff9fae00a1f980 0t0 23067 type=STREAM 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 2u unix 0xffff9fae00a1f980 0t0 23067 type=STREAM 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 3u unix 0xffff9fae00b58d80 0t0 1800 /var/run/cups/cups.sock type=STREAM 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 6u unix 0xffff9fae0097f080 0t0 22517 type=STREAM 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 7r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 8u unix 0xffff9fae00b6de80 0t0 31213 type=STREAM 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 9u IPv6 31214 0t0 TCP localhost:ipp (LISTEN) 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 10u IPv4 31215 0t0 TCP localhost:ipp (LISTEN) 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 11r FIFO 0,13 0t0 31216 pipe 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:cupsd 1043 root 12w FIFO 0,13 0t0 31216 pipe 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root txt REG 8,1 75704 8472 /usr/sbin/crond 2023-07-29T16:46:19.727 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.728 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.729 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.730 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 1u unix 0xffff9fae00bac800 0t0 28292 type=STREAM 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 2u unix 0xffff9fae00bac800 0t0 28292 type=STREAM 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 3uW REG 0,24 5 28373 /run/crond.pid 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 4u unix 0xffff9fae00bab600 0t0 28374 type=DGRAM 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.731 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 7r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:crond 1047 root 8u unix 0xffff9fadc94df080 0t0 21078 type=STREAM 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root cwd DIR 8,1 4096 66695 /var/spool/at 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root txt REG 8,1 34144 9429 /usr/sbin/atd 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.732 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.733 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.734 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 4u unix 0xffff9fae00b6c380 0t0 31205 type=STREAM 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 5r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:atd 1048 root 6uW REG 0,24 5 31208 /run/atd.pid 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe txt REG 8,1 82312 32484 /usr/sbin/nrpe 2023-07-29T16:46:19.735 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.736 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 2w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 4u unix 0xffff9fae00b68000 0t0 31349 type=DGRAM 2023-07-29T16:46:19.737 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 5r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 6u IPv4 31358 0t0 TCP *:nrpe (LISTEN) 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:nrpe 1238 nrpe 7u IPv6 31359 0t0 TCP *:nrpe (LISTEN) 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.738 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.740 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.741 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 2w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 3r CHR 1,9 0t0 3080 /dev/urandom 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 4u unix 0xffff9fae00a19f80 0t0 23089 type=DGRAM 2023-07-29T16:46:19.742 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 6w REG 8,1 106745 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 7r REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 8r REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 9w REG 8,1 1451290 66911 /var/log/messages 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 10w REG 8,1 931920 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 11w REG 8,1 842629 66912 /var/log/secure 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 root 12w REG 8,1 5093 66853 /var/log/cron 2023-07-29T16:46:19.743 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T16:46:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.746 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.747 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 2w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 3r CHR 1,9 0t0 3080 /dev/urandom 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 4u unix 0xffff9fae00a19f80 0t0 23089 type=DGRAM 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 6w REG 8,1 106745 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 7r REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.748 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 8r REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 9w REG 8,1 1451290 66911 /var/log/messages 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 10w REG 8,1 931920 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 11w REG 8,1 842629 66912 /var/log/secure 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1293 in:imjour root 12w REG 8,1 5093 66853 /var/log/cron 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-07-29T16:46:19.749 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.750 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.751 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.752 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 1w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 2w CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 3r CHR 1,9 0t0 3080 /dev/urandom 2023-07-29T16:46:19.753 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 4u unix 0xffff9fae00a19f80 0t0 23089 type=DGRAM 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 5r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 6w REG 8,1 106745 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 7r REG 0,24 8388608 17960 /run/log/journal/da67a47599a1df2336ed73a864c53e8e/system.journal 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 8r REG 0,24 8388608 17466 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 9w REG 8,1 1451290 66911 /var/log/messages 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 10w REG 8,1 931920 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 11w REG 8,1 842629 66912 /var/log/secure 2023-07-29T16:46:19.754 INFO:teuthology.orchestra.run.smithi151.stdout:rsyslogd 1243 1297 rs:main root 12w REG 8,1 5093 66853 /var/log/cron 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.755 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 0u CHR 4,1 0t0 3089 /dev/tty1 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 1u CHR 4,1 0t0 3089 /dev/tty1 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 2u CHR 4,1 0t0 3089 /dev/tty1 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 3r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 4u unix 0xffff9fae0097d100 0t0 41152 type=STREAM 2023-07-29T16:46:19.756 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3853 root 6r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.757 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.758 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 0u CHR 4,65 0t0 13277 /dev/ttyS1 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 1u CHR 4,65 0t0 13277 /dev/ttyS1 2023-07-29T16:46:19.759 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 2u CHR 4,65 0t0 13277 /dev/ttyS1 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 3r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 4u unix 0xffff9fae42ff3a80 0t0 40907 type=STREAM 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:agetty 3854 root 6r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6008 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6008 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:kworker/0 6008 root txt unknown /proc/6008/exe 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root txt REG 8,1 38296 7205 /usr/bin/sleep 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root 1u unix 0xffff9fae00b69f80 0t0 30881 type=STREAM 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sleep 6033 root 2u unix 0xffff9fae00b69f80 0t0 30881 type=STREAM 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T16:46:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-07-29T16:46:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-07-29T16:46:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.769 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.771 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 3u unix 0xffff9fae00ba8480 0t0 47223 type=DGRAM 2023-07-29T16:46:19.772 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 5u IPv4 44139 0t0 TCP smithi151.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:47774 (ESTABLISHED) 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 6u unix 0xffff9fae00ba8900 0t0 47113 type=STREAM 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 7r REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 8r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 9u unix 0xffff9fae00babf00 0t0 47117 type=STREAM 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 11w FIFO 0,24 0t0 46235 /run/systemd/sessions/1.ref 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6034 root 12u unix 0xffff9fae00ba8000 0t0 47227 type=STREAM 2023-07-29T16:46:19.773 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.775 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.776 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-07-29T16:46:19.777 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.778 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 1u unix 0xffff9fadc94dec00 0t0 43384 type=STREAM 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 2u unix 0xffff9fadc94dec00 0t0 43384 type=STREAM 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 3u unix 0xffff9fadc94da400 0t0 43401 type=DGRAM 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 4u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 5u a_inode 0,14 0 12460 [signalfd] 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 6r DIR 0,26 0 818 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-07-29T16:46:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 7u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 8u netlink 0t0 43408 KOBJECT_UEVENT 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 9u a_inode 0,14 0 12460 [eventpoll] 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 10r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 11u unix 0xffff9fadc94df500 0t0 43426 /run/user/1000/bus type=STREAM 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 12r REG 0,5 0 43413 /proc/6039/mountinfo 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 13r a_inode 0,14 0 12460 inotify 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-07-29T16:46:19.780 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 15u unix 0xffff9fadc94d8900 0t0 43414 /run/user/1000/systemd/notify type=DGRAM 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 16u unix 0xffff9fadc94dda00 0t0 43416 type=DGRAM 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 17u unix 0xffff9fadc94d9680 0t0 43417 type=DGRAM 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 18u unix 0xffff9fadc94d9f80 0t0 43418 /run/user/1000/systemd/private type=STREAM 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 19u unix 0xffff9fadc94de780 0t0 43420 type=STREAM 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 20u a_inode 0,14 0 12460 [timerfd] 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:systemd 6039 ubuntu 26u netlink 0t0 43429 SELINUX 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.781 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-07-29T16:46:19.782 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.784 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.785 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-07-29T16:46:19.786 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.787 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.788 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.789 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 576141 25076 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 0r CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 1u unix 0xffff9fadc94dec00 0t0 43384 type=STREAM 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 2u unix 0xffff9fadc94dec00 0t0 43384 type=STREAM 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 4r REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 5u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 6u a_inode 0,14 0 12460 [eventfd] 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 8w FIFO 0,13 0t0 43385 pipe 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 9u unix 0xffff9fadc94dc800 0t0 43397 type=STREAM 2023-07-29T16:46:19.791 INFO:teuthology.orchestra.run.smithi151.stdout:(sd-pam) 6042 ubuntu 10u unix 0xffff9fadc94dad00 0t0 43398 type=DGRAM 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu cwd DIR 8,1 4096 2 / 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.792 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-07-29T16:46:19.793 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-07-29T16:46:19.794 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-07-29T16:46:19.795 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-07-29T16:46:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-07-29T16:46:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.798 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.799 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 0u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.800 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 1u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 2u CHR 1,3 0t0 3075 /dev/null 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 3u unix 0xffff9fae00ba8480 0t0 47223 type=DGRAM 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 5u IPv4 44139 0t0 TCP smithi151.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:47774 (ESTABLISHED) 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 6u unix 0xffff9fae00ba8900 0t0 47113 type=STREAM 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 7r REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 8r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.801 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 9u unix 0xffff9fae00babf00 0t0 47117 type=STREAM 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 10u unix 0xffff9fae00bad580 0t0 47226 type=STREAM 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 11w FIFO 0,24 0t0 46235 /run/systemd/sessions/1.ref 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 12r FIFO 0,13 0t0 35715 pipe 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 13w FIFO 0,13 0t0 35715 pipe 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 18r FIFO 0,13 0t0 47271 pipe 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:sshd 6048 ubuntu 20r FIFO 0,13 0t0 47272 pipe 2023-07-29T16:46:19.802 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.803 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.804 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu 0r FIFO 0,13 0t0 47270 pipe 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu 1w FIFO 0,13 0t0 47271 pipe 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:bash 6090 ubuntu 2w FIFO 0,13 0t0 47272 pipe 2023-07-29T16:46:19.805 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root txt REG 8,1 165528 9884 /usr/bin/sudo 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-07-29T16:46:19.806 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.807 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-07-29T16:46:19.808 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.809 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-07-29T16:46:19.810 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-07-29T16:46:19.811 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 432960 47003 /usr/libexec/sudo/sudoers.so 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 104520 47000 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-07-29T16:46:19.814 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 0r FIFO 0,13 0t0 47270 pipe 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 1w FIFO 0,13 0t0 47271 pipe 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 2w FIFO 0,13 0t0 47272 pipe 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 4u unix 0xffff9fae00b5bf00 0t0 44252 type=STREAM 2023-07-29T16:46:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 5u netlink 0t0 44260 AUDIT 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 6r REG 8,1 11567160 66905 /var/lib/sss/mc/initgroups 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 7r REG 8,1 6940392 66899 /var/lib/sss/mc/group 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 9u unix 0xffff9fae00b5ad00 0t0 44263 type=DGRAM 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 10r FIFO 0,13 0t0 44266 pipe 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:sudo 6109 root 11w FIFO 0,13 0t0 44266 pipe 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.816 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.817 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.818 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 0r FIFO 0,13 0t0 47270 pipe 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 1w FIFO 0,13 0t0 47271 pipe 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 2w FIFO 0,13 0t0 47272 pipe 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 3r DIR 0,5 0 1 /proc 2023-07-29T16:46:19.819 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 4r DIR 0,5 0 35751 /proc/6111/fd 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 5w FIFO 0,13 0t0 35761 pipe 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6111 root 6r FIFO 0,13 0t0 35762 pipe 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root rtd DIR 8,1 4096 2 / 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-07-29T16:46:19.820 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-07-29T16:46:19.821 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-07-29T16:46:19.822 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root 4r FIFO 0,13 0t0 35761 pipe 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:lsof 6112 root 7w FIFO 0,13 0t0 35762 pipe 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:root 2 0.0 0.0 0 0 ? S 16:41 0:00 [kthreadd] 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:root 3 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [rcu_gp] 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:root 4 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [rcu_par_gp] 2023-07-29T16:46:19.823 INFO:teuthology.orchestra.run.smithi151.stdout:root 5 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/0:0-cgroup_pidlist_destroy] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 6 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/0:0H-events_highpri] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 7 0.1 0.0 0 0 ? I 16:41 0:00 \_ [kworker/0:1-kacpi_notify] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 8 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:0-events_unbound] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 9 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [mm_percpu_wq] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 10 0.0 0.0 0 0 ? S 16:41 0:00 \_ [rcu_tasks_rude_] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 11 0.0 0.0 0 0 ? S 16:41 0:00 \_ [rcu_tasks_trace] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 12 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/0] 2023-07-29T16:46:19.824 INFO:teuthology.orchestra.run.smithi151.stdout:root 13 0.0 0.0 0 0 ? I 16:41 0:00 \_ [rcu_sched] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 14 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/0] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 15 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/0] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 16 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/0] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 17 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/1] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 18 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/1] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 19 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/1] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 20 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/1] 2023-07-29T16:46:19.825 INFO:teuthology.orchestra.run.smithi151.stdout:root 21 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/1:0-events] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 22 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/1:0H-events_highpri] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 23 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/2] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 24 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/2] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 25 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/2] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 26 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/2] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 27 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/2:0-events] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 28 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/2:0H-events_highpri] 2023-07-29T16:46:19.826 INFO:teuthology.orchestra.run.smithi151.stdout:root 29 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/3] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 30 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/3] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 31 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/3] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 32 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/3] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 33 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/3:0-cgroup_pidlist_destroy] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 34 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/3:0H-events_highpri] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 35 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/4] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 36 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/4] 2023-07-29T16:46:19.827 INFO:teuthology.orchestra.run.smithi151.stdout:root 37 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/4] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 38 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/4] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 39 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/4:0-events] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 40 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/4:0H-events_highpri] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 41 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/5] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 42 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/5] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 43 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/5] 2023-07-29T16:46:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:root 44 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/5] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 45 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/5:0-cgroup_pidlist_destroy] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 46 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/5:0H-events_highpri] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 47 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/6] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 48 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/6] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 49 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/6] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 50 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/6] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 51 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/6:0-cgroup_pidlist_destroy] 2023-07-29T16:46:19.829 INFO:teuthology.orchestra.run.smithi151.stdout:root 52 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/6:0H-events_highpri] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 53 0.0 0.0 0 0 ? S 16:41 0:00 \_ [cpuhp/7] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 54 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdog/7] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 55 0.0 0.0 0 0 ? S 16:41 0:00 \_ [migration/7] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 56 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ksoftirqd/7] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 57 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/7:0-events] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 58 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/7:0H-events_highpri] 2023-07-29T16:46:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:root 60 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:1-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 61 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:2-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 62 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:3-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 63 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:4-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 64 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:5-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 65 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:6-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 66 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:7-events_unbound] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 67 0.0 0.0 0 0 ? S 16:41 0:00 \_ [kdevtmpfs] 2023-07-29T16:46:19.831 INFO:teuthology.orchestra.run.smithi151.stdout:root 68 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [netns] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 69 0.0 0.0 0 0 ? S 16:41 0:00 \_ [kauditd] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 70 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/4:1-events] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 71 0.0 0.0 0 0 ? S 16:41 0:00 \_ [khungtaskd] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 72 0.0 0.0 0 0 ? S 16:41 0:00 \_ [oom_reaper] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 73 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [writeback] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 74 0.0 0.0 0 0 ? S 16:41 0:00 \_ [kcompactd0] 2023-07-29T16:46:19.832 INFO:teuthology.orchestra.run.smithi151.stdout:root 75 0.0 0.0 0 0 ? SN 16:41 0:00 \_ [ksmd] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 76 0.0 0.0 0 0 ? SN 16:41 0:00 \_ [khugepaged] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 77 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [crypto] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 78 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kintegrityd] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 79 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kblockd] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 80 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [blkcg_punt_bio] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 81 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/2:1-events] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 82 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/1:1-mm_percpu_wq] 2023-07-29T16:46:19.833 INFO:teuthology.orchestra.run.smithi151.stdout:root 83 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/3:1-mm_percpu_wq] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 84 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/5:1-cgroup_pidlist_destroy] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 85 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/7:1-cgroup_destroy] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 86 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/6:1-cgroup_pidlist_destroy] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 87 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [tpm_dev_wq] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 88 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [md] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 89 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [edac-poller] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 90 0.0 0.0 0 0 ? S 16:41 0:00 \_ [watchdogd] 2023-07-29T16:46:19.834 INFO:teuthology.orchestra.run.smithi151.stdout:root 91 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/1:1H-kblockd] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 124 0.0 0.0 0 0 ? S 16:41 0:00 \_ [kswapd0] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 226 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kthrotld] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 227 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [acpi_thermal_pm] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 228 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/7:2-cgroup_pidlist_destroy] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 229 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kmpath_rdacd] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 230 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kaluad] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 231 0.1 0.0 0 0 ? I 16:41 0:00 \_ [kworker/2:2-events] 2023-07-29T16:46:19.835 INFO:teuthology.orchestra.run.smithi151.stdout:root 232 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/6:1H-kblockd] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 233 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [ipv6_addrconf] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 234 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kstrp] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 235 0.1 0.0 0 0 ? I 16:41 0:00 \_ [kworker/6:2-events] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 294 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/2:3-cgroup_pidlist_destroy] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 316 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/3:1H-kblockd] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 348 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/2:1H-kblockd] 2023-07-29T16:46:19.836 INFO:teuthology.orchestra.run.smithi151.stdout:root 351 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/4:1H-kblockd] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 352 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/7:1H-kblockd] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 373 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/5:1H-kblockd] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 377 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/3:2-events] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 378 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/3:3-cgroup_pidlist_destroy] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 380 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/0:1H-kblockd] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 476 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/0:2-cgroup_pidlist_destroy] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 488 0.1 0.0 0 0 ? I 16:41 0:00 \_ [kworker/7:3-events_freezable] 2023-07-29T16:46:19.837 INFO:teuthology.orchestra.run.smithi151.stdout:root 489 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/7:4] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 495 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/6:3-events] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 503 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [nvme-wq] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 504 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [nvme-reset-wq] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 505 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [nvme-delete-wq] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 506 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [ata_sff] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 512 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_0] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 513 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_0] 2023-07-29T16:46:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:root 514 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [ixgbe] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 515 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_1] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 516 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_1] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 517 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_2] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 518 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_2] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 519 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_3] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 520 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_3] 2023-07-29T16:46:19.839 INFO:teuthology.orchestra.run.smithi151.stdout:root 521 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_4] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 522 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_4] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 523 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_5] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 524 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_5] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 525 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_6] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 526 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_6] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 527 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_7] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 528 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_7] 2023-07-29T16:46:19.840 INFO:teuthology.orchestra.run.smithi151.stdout:root 529 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_8] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 530 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_8] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 531 0.0 0.0 0 0 ? S 16:41 0:00 \_ [scsi_eh_9] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 532 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [scsi_tmf_9] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 535 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:8-writeback] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 536 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:9-writeback] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 537 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/u16:10] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 551 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/4:2-cgroup_destroy] 2023-07-29T16:46:19.841 INFO:teuthology.orchestra.run.smithi151.stdout:root 565 0.0 0.0 0 0 ? S 16:41 0:00 \_ [jbd2/sda1-8] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 566 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [ext4-rsv-conver] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 598 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/1:2-cgroup_pidlist_destroy] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 636 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/5:2-events] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 674 0.0 0.0 0 0 ? S 16:41 0:00 \_ [ext4lazyinit] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 697 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/4:3-events] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 754 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [rpciod] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 755 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kworker/u17:0] 2023-07-29T16:46:19.842 INFO:teuthology.orchestra.run.smithi151.stdout:root 756 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xprtiod] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 777 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kdmflush/253:0] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 778 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kdmflush/253:1] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 779 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kdmflush/253:2] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 780 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kdmflush/253:3] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 781 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [kdmflush/253:4] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 790 0.0 0.0 0 0 ? SN 16:41 0:00 \_ [kipmi0] 2023-07-29T16:46:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:root 844 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/1:3-events] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 858 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfsalloc] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 859 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs_mru_cache] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 860 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-buf/dm-4] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 861 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-conv/dm-4] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 862 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-cil/dm-4] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 863 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-reclaim/dm-] 2023-07-29T16:46:19.844 INFO:teuthology.orchestra.run.smithi151.stdout:root 864 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-blockgc/dm-] 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 865 0.0 0.0 0 0 ? I< 16:41 0:00 \_ [xfs-log/dm-4] 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 866 0.0 0.0 0 0 ? S 16:41 0:00 \_ [xfsaild/dm-4] 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 958 0.0 0.0 0 0 ? I 16:41 0:00 \_ [kworker/5:3-events] 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 6008 0.0 0.0 0 0 ? I 16:42 0:00 \_ [kworker/0:3-events] 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 1 0.7 0.0 241452 14372 ? Ss 16:41 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 18 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 662 0.0 0.0 89492 11404 ? Ss 16:41 0:00 /usr/lib/systemd/systemd-journald 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:root 707 0.1 0.0 117176 13428 ? Ss 16:41 0:00 /usr/lib/systemd/systemd-udevd 2023-07-29T16:46:19.845 INFO:teuthology.orchestra.run.smithi151.stdout:rpc 748 0.0 0.0 67220 5496 ? Ss 16:41 0:00 /usr/bin/rpcbind -w -f 2023-07-29T16:46:19.846 INFO:teuthology.orchestra.run.smithi151.stdout:root 752 0.0 0.0 148732 2792 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T16:46:19.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T16:46:19.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T16:46:19.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T16:46:19.897 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T16:46:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T16:46:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T16:46:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T16:46:19.914 INFO:tasks.ceph:Archiving crash dumps... 2023-07-29T16:46:19.916 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi070/crash 2023-07-29T16:46:19.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T16:46:19.963 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi098/crash 2023-07-29T16:46:19.964 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T16:46:20.008 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi102/crash 2023-07-29T16:46:20.009 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T16:46:20.057 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi151/crash 2023-07-29T16:46:20.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T16:46:20.099 INFO:tasks.ceph:Compressing logs... 2023-07-29T16:46:20.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:46:20.102 DEBUG:teuthology.orchestra.run.smithi098:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:46:20.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:46:20.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:46:58.549 INFO:tasks.ceph:Archiving logs... 2023-07-29T16:46:58.550 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi070/log 2023-07-29T16:46:58.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T16:46:58.738 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi098/log 2023-07-29T16:46:58.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T16:47:01.667 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi102/log 2023-07-29T16:47:01.668 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T16:47:05.223 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi151/log 2023-07-29T16:47:05.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T16:47:06.205 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1934, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1197, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph.py", line 1179, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi151 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-2' 2023-07-29T16:47:06.206 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-29T16:47:06.217 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T16:47:06.217 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-29T16:47:06.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T16:47:06.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T16:47:06.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T16:47:06.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T16:47:06.378 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-29T16:47:06.389 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-29T16:47:06.389 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:47:06.392 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:47:06.394 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:47:06.396 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T16:47:06.408 INFO:teuthology.orchestra.run.smithi070.stderr:bash: ntpq: command not found 2023-07-29T16:47:06.411 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-07-29T16:47:06.413 INFO:teuthology.orchestra.run.smithi102.stderr:bash: ntpq: command not found 2023-07-29T16:47:06.413 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:47:06.413 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2023-07-29T16:47:06.413 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +2155us[+2177us] +/- 99ms 2023-07-29T16:47:06.414 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -3675us[-3652us] +/- 74ms 2023-07-29T16:47:06.414 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +2214us[+2214us] +/- 76ms 2023-07-29T16:47:06.414 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:47:06.414 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-07-29T16:47:06.415 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:47:06.416 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-07-29T16:47:06.416 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +2135us[+2135us] +/- 99ms 2023-07-29T16:47:06.416 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -3687us[-3652us] +/- 74ms 2023-07-29T16:47:06.416 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +2149us[+2184us] +/- 76ms 2023-07-29T16:47:06.416 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:47:06.417 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:47:06.417 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-07-29T16:47:06.418 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +2149us[+2171us] +/- 99ms 2023-07-29T16:47:06.418 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -3667us[-3646us] +/- 74ms 2023-07-29T16:47:06.418 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +2167us[+2167us] +/- 76ms 2023-07-29T16:47:06.418 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:47:06.419 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T16:47:06.419 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-07-29T16:47:06.419 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +2157us[+2157us] +/- 98ms 2023-07-29T16:47:06.420 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -3686us[-3685us] +/- 74ms 2023-07-29T16:47:06.420 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +2165us[+2165us] +/- 76ms 2023-07-29T16:47:06.420 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T16:47:06.420 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-29T16:47:06.430 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-29T16:47:06.431 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-29T16:47:06.441 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T16:47:06.553 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T16:47:06.652 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T16:47:06.751 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T16:47:06.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:47:06.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:06.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:47:06.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:06.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:47:07.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:07.017 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T16:47:07.051 INFO:teuthology.orchestra.run.smithi151.stdout:type=AVC msg=audit(1690648892.899:45): avc: denied { node_bind } for pid=3833 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2023-07-29T16:47:07.052 DEBUG:teuthology.task.selinux:ubuntu@smithi151.front.sepia.ceph.com has 1 denials 2023-07-29T16:47:07.053 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi151.front.sepia.ceph.com: ['type=AVC msg=audit(1690648892.899:45): avc: denied { node_bind } for pid=3833 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-07-29T16:47:07.053 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-29T16:47:07.063 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-29T16:47:07.073 INFO:teuthology.task.internal:Duration was 1266.889141 seconds 2023-07-29T16:47:07.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-29T16:47:07.085 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-29T16:47:07.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T16:47:07.088 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T16:47:07.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T16:47:07.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T16:47:07.138 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:47:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:47:07.141 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:47:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T16:47:07.477 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-29T16:47:07.477 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2023-07-29T16:47:07.478 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T16:47:07.504 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2023-07-29T16:47:07.505 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T16:47:07.530 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2023-07-29T16:47:07.531 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T16:47:07.553 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-07-29T16:47:07.554 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T16:47:07.578 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-29T16:47:07.579 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:47:07.581 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:47:07.584 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:47:07.596 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T16:47:07.677 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-29T16:47:07.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:07.680 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:07.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:07.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:07.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-29T16:47:07.770 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-29T16:47:07.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T16:47:07.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T16:47:07.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T16:47:07.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T16:47:07.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-29T16:47:07.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:07.946 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:07.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:07.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:07.971 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2023-07-29T16:47:07.972 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2023-07-29T16:47:07.974 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2023-07-29T16:47:08.008 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-07-29T16:47:08.043 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:08.059 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi070.front.sepia.ceph.com, flagging run as failed 2023-07-29T16:47:08.060 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:08.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:08.076 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:08.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:08.093 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:08.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:08.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-29T16:47:08.121 INFO:teuthology.task.internal:Transferring archived files... 2023-07-29T16:47:08.122 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi070 2023-07-29T16:47:08.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T16:47:16.695 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-07-29T16:47:16.710 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886/remote/smithi070/coredump/1690648817.93947.core.gz: gzip compressed data, was "1690648817.93947.core", last modified: Sat Jul 29 16:47:08 2023, max compression 2023-07-29T16:47:16.711 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-07-29T16:47:17.304 INFO:teuthology.task.internal: core looks like: /tmp/tmp1kgl30ij: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mon -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mon', platform: 'x86_64' 2023-07-29T16:47:17.329 INFO:teuthology.task.internal: dump_program: ceph-mon -f --cluster ceph -i a 2023-07-29T16:47:17.330 DEBUG:teuthology.orchestra.run.smithi070:> which 'ceph-mon -f --cluster ceph -i a' 2023-07-29T16:47:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:/usr/bin/which: invalid option -- 'f' 2023-07-29T16:47:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-07-29T16:47:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:/usr/bin/which: no a in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-07-29T16:47:17.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:17.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-mon 2023-07-29T16:47:17.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph 2023-07-29T16:47:17.354 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 1: "which 'ceph-mon -f --cluster ceph -i a'" 2023-07-29T16:47:17.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-29T16:47:17.365 INFO:teuthology.task.internal:Not uploading archives. 2023-07-29T16:47:17.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-29T16:47:17.377 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-29T16:47:17.377 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T16:47:17.395 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T16:47:17.398 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T16:47:17.401 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T16:47:17.413 INFO:teuthology.orchestra.run.smithi070.stdout: 262320 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest 2023-07-29T16:47:17.413 INFO:teuthology.orchestra.run.smithi070.stdout: 262325 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive 2023-07-29T16:47:17.413 INFO:teuthology.orchestra.run.smithi070.stdout: 393241 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit 2023-07-29T16:47:17.413 INFO:teuthology.orchestra.run.smithi070.stdout: 393243 240 -rw------- 1 ubuntu ubuntu 242898 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-29T16:47:17.413 INFO:teuthology.orchestra.run.smithi070.stdout: 262326 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:40 /home/ubuntu/cephtest/archive/coredump 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 262149 51568 -rw------- 1 root root 161189888 Jul 29 16:40 /home/ubuntu/cephtest/archive/coredump/1690648817.93947.core 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 262327 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 262150 4 -rw-rw-rw- 1 ubuntu ubuntu 696 Jul 29 16:40 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 262151 108 -rw-rw-rw- 1 ubuntu ubuntu 108118 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 262152 104 -rw-rw-r-- 1 ubuntu ubuntu 104856 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:17.414 INFO:teuthology.orchestra.run.smithi070.stdout: 393222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:37 /home/ubuntu/cephtest/ceph.data 2023-07-29T16:47:17.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T16:47:17.415 INFO:teuthology.orchestra.run.smithi070.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T16:47:17.416 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/thrashosds.py", line 215, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2779, in wait_for_all_osds_up while not self.are_all_osds_up(): File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2769, in are_all_osds_up x = self.get_osd_dump() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2532, in get_osd_dump return self.get_osd_dump_json()['osds'] File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 2524, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-07-29T16:47:17.416 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-29T16:47:17.428 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-29T16:47:17.441 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi070 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-07-29T16:47:17.441 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T16:47:17.445 INFO:teuthology.orchestra.run.smithi151.stdout: 262320 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 262325 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 393217 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 393219 228 -rw------- 1 ubuntu ubuntu 232907 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 262327 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 262166 20 -rw-rw-rw- 1 ubuntu ubuntu 20208 Jul 29 16:41 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-29T16:47:17.446 INFO:teuthology.orchestra.run.smithi151.stdout: 262167 116 -rw-rw-rw- 1 ubuntu ubuntu 114846 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: 262169 28 -rw-rw-r-- 1 ubuntu ubuntu 26668 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: 393222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:37 /home/ubuntu/cephtest/ceph.data 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi151.stdout: 262303 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 16:37 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi102.stdout: 262320 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi102.stdout: 262325 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive 2023-07-29T16:47:17.447 INFO:teuthology.orchestra.run.smithi102.stdout: 393240 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 393242 236 -rw------- 1 ubuntu ubuntu 241013 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 262327 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 262149 4 -rw-rw-rw- 1 ubuntu ubuntu 540 Jul 29 16:46 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 262150 108 -rw-rw-rw- 1 ubuntu ubuntu 107806 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 262151 104 -rw-rw-r-- 1 ubuntu ubuntu 103609 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 393222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:37 /home/ubuntu/cephtest/ceph.data 2023-07-29T16:47:17.448 INFO:teuthology.orchestra.run.smithi102.stdout: 262303 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 16:37 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 262170 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 262321 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 393240 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 393242 236 -rw------- 1 ubuntu ubuntu 240839 Jul 29 16:47 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 262323 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog 2023-07-29T16:47:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: 262149 4 -rw-rw-rw- 1 ubuntu ubuntu 530 Jul 29 16:46 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-29T16:47:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: 262150 108 -rw-rw-rw- 1 ubuntu ubuntu 107688 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-29T16:47:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: 262151 104 -rw-rw-r-- 1 ubuntu ubuntu 103866 Jul 29 16:47 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T16:47:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: 393222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 16:37 /home/ubuntu/cephtest/ceph.data 2023-07-29T16:47:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: 262303 4 -rw-rw-r-- 1 ubuntu ubuntu 409 Jul 29 16:37 /home/ubuntu/cephtest/ceph.monmap 2023-07-29T16:47:17.451 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T16:47:17.452 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T16:47:17.452 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-29T16:47:17.479 DEBUG:teuthology.nuke:shortname: smithi070 2023-07-29T16:47:17.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:47:17.504 DEBUG:teuthology.nuke:shortname: smithi098 2023-07-29T16:47:17.505 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:47:17.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.863685', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-29T16:47:17.527 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-29T16:47:17.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:47:17.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.862188', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-29T16:47:17.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.866376', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T16:47:17.552 DEBUG:teuthology.nuke:shortname: smithi151 2023-07-29T16:47:17.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:47:17.567 INFO:teuthology.orchestra.console.smithi070:Power off 2023-07-29T16:47:17.568 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:47:17.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:04:17-powercycle-reef-release-distro-default-smithi/7356886', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 16:20:29.865045', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-29T16:47:17.591 INFO:teuthology.orchestra.console.smithi098:Power off 2023-07-29T16:47:17.591 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:47:17.606 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-07-29T16:47:17.607 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:17.617 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-07-29T16:47:17.618 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:17.628 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-07-29T16:47:17.639 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-07-29T16:47:17.645 INFO:teuthology.orchestra.console.smithi102:Power off 2023-07-29T16:47:17.645 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:47:17.668 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-07-29T16:47:17.669 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:17.691 INFO:teuthology.orchestra.console.smithi151:Power off 2023-07-29T16:47:17.692 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:47:17.702 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-29T16:47:17.713 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-07-29T16:47:17.713 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:17.736 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:47:21.629 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:21.640 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:21.703 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:21.737 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:21.750 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-07-29T16:47:21.752 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-07-29T16:47:21.815 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-29T16:47:21.850 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:47:25.752 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:25.761 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:25.816 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:25.851 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:25.863 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-07-29T16:47:25.873 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-07-29T16:47:25.929 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-07-29T16:47:25.962 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-07-29T16:47:25.965 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-07-29T16:47:29.876 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:29.930 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:29.964 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:47:29.987 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-07-29T16:47:30.043 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-07-29T16:47:30.075 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-07-29T16:47:30.088 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-07-29T16:47:30.144 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-07-29T16:47:30.175 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-07-29T16:47:30.280 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1266.8891413211823 failure_reason: 'Command failed on smithi070 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json''' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-07-29T16:47:30.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:47:30.367 INFO:teuthology.run:FAIL